Sep 25 11:25:55 devstack cinder-volume[76135]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 11:25:55 devstack cinder-volume[76135]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 11:25:55 devstack cinder-volume[76135]: we strongly recommend against using it for new projects. Sep 25 11:25:55 devstack cinder-volume[76135]: If you are already using Eventlet, we recommend migrating to a different Sep 25 11:25:55 devstack cinder-volume[76135]: framework. For more detail see Sep 25 11:25:55 devstack cinder-volume[76135]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 11:25:55 devstack cinder-volume[76135]: import eventlet # noqa Sep 25 11:25:58 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:25:58 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:25:58 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:25:59 devstack cinder-volume[76135]: INFO dbcounter [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Registered counter for database cinder Sep 25 11:25:59 devstack cinder-volume[76135]: DEBUG oslo_db.sqlalchemy.engines [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76135) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:25:59 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writer thread running {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:25:59 devstack cinder-volume[76135]: INFO cinder.rpc [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 11:25:59 devstack cinder-volume[76135]: INFO cinder.rpc [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_db.sqlalchemy.engines [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76135) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:26:00 devstack cinder-volume[76135]: INFO cinder.volume.manager [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Determined volume DB was empty at startup. Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76135) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 11:26:00 devstack cinder-volume[76135]: INFO cinder.volume.manager [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 11:26:00 devstack cinder-volume[76135]: WARNING stevedore.named [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 11:26:00 devstack cinder-volume[76135]: WARNING castellan.key_manager [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:26:00 devstack cinder-volume[76135]: WARNING cinder.keymgr.conf_key_mgr [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG cinder.volume.drivers.lvm [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76135) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.514s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_db.sqlalchemy.engines [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76135) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:26:00 devstack cinder-volume[76135]: INFO cinder.rpc [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 11:26:00 devstack cinder-volume[76135]: INFO cinder.rpc [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 11:26:00 devstack cinder-volume[76135]: WARNING stevedore.named [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 11:26:00 devstack cinder-volume[76135]: WARNING castellan.key_manager [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:26:00 devstack cinder-volume[76135]: INFO cinder.volume.manager [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_db.sqlalchemy.engines [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76135) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:26:00 devstack cinder-volume[76135]: INFO oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Starting 1 workers Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Started child 76470 {{(pid=76135) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Full set of CONF: {{(pid=76135) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] ******************************************************************************** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Configuration options gathered from: {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] ================================================================================ {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] allow_availability_zone_fallback = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] allow_compression_on_image_upload = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] allowed_direct_url_schemes = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] api_rate_limit = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] auth_strategy = keystone {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] az_cache_duration = 3600 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_availability_zone = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_host = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_stats_polling_interval = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backup_api_class = cinder.backup.api.API {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backup_name_template = backup-%s {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backup_use_same_host = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backup_use_temp_snapshot = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] chap_password = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] chap_username = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76470]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_internal_tenant_project_id = 76a97016647c4103ba0fa4befbad8109 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_internal_tenant_user_id = 2316a7862bc64e509173b6fdcca9ac48 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cloned_volume_same_az = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cluster = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] compression_format = gzip {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] compute_api_class = cinder.compute.nova.API {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] config_dir = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] config_source = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] control_exchange = openstack {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] debug = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] default_availability_zone = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] default_group_type = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] default_volume_type = lvmdriver-1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] disk_geometry = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] driver_client_cert = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] driver_client_cert_key = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] driver_data_namespace = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] driver_ssl_cert_path = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] driver_ssl_cert_verify = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] driver_use_ssl = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] enable_force_upload = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] enable_new_services = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] enable_unsupported_driver = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] enforce_multipath_for_image_xfer = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] filter_function = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_api_insecure = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_api_servers = ['http://192.168.122.183/image'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_api_ssl_compression = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_ca_certificates_file = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_catalog_info = image:glance:publicURL {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_certfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_keyfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_num_retries = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance_request_timeout = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] goodness_function = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] graceful_shutdown_timeout = 5 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] group_api_class = cinder.group.api.API {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] host = devstack {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_compress_on_upload = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_conversion_address_space_limit = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_conversion_cpu_limit = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_conversion_disable = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_introspection_address_space_limit = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_introspection_cpu_limit = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_upload_use_cinder_backend = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_upload_use_internal_tenant = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_volume_cache_enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_volume_cache_max_count = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] image_volume_cache_max_size_gb = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] init_host_max_objects_retrieval = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] instance_format = [instance: %(uuid)s] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] iscsi_target_flags = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] iscsi_write_cache = on {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] iser_helper = tgtadm {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] iser_ip_address = 192.168.122.183 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] iser_port = 3260 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_color = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_config_append = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_dir = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_file = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_options = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_rotate_interval = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_rotate_interval_type = days {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] log_rotation_type = none {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] max_age = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] max_logfile_count = 30 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] max_logfile_size_mb = 200 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] max_over_subscription_ratio = 20.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] message_reap_interval = 86400 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] message_ttl = 2592000 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] migration_create_volume_timeout_secs = 300 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] monkey_patch = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] monkey_patch_modules = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] my_ip = 192.168.122.183 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] no_snapshot_gb_quota = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] num_iser_scan_tries = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] num_shell_tries = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] num_volume_device_scan_tries = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] nvmeof_conn_info_version = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76470]: INFO cinder.volume.manager [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] nvmet_ns_id = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] nvmet_port_id = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] osapi_max_limit = 1000 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] osapi_volume_ext_list = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] osapi_volume_listen_port = 8776 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] osapi_volume_use_ssl = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] osapi_volume_workers = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] per_volume_size_limit = -1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] periodic_fuzzy_delay = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] periodic_interval = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] public_endpoint = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] publish_errors = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] quota_backup_gigabytes = 1000 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] quota_backups = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] quota_gigabytes = 1000 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] quota_groups = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] quota_snapshots = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] quota_volumes = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] rate_limit_burst = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] rate_limit_except_level = CRITICAL {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] rate_limit_interval = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] reinit_driver_count = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] replication_device = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] report_discard_supported = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] report_interval = 120 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] reservation_clean_interval = 86400 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] reservation_expire = 86400 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] reserved_image_namespaces = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] reserved_percentage = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] rpc_response_timeout = 120 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] run_external_periodic_tasks = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] scst_target_driver = iscsi {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] scst_target_iqn_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_down_time = 720 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] shell_completion = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] snapshot_name_template = snapshot-%s {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] snapshot_same_host = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] split_loggers = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] state_path = /opt/stack/data/cinder {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] storage_availability_zone = nova {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] storage_protocol = iSCSI {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] syslog_log_facility = LOG_USER {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] target_helper = lioadm {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] target_ip_address = 192.168.122.183 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] target_port = 3260 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] target_protocol = iscsi {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] target_secondary_ip_addresses = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] trace_flags = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] transport_url = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] until_refresh = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] use_chap_auth = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] use_default_quota_class = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] use_journal = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] use_json = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] use_multipath_for_image_xfer = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] use_stderr = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] use_syslog = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] verify_glance_signatures = enabled {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_api_class = cinder.volume.api.API {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_backend_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_clear = zero {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_clear_ionice = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_clear_size = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_copy_bps_limit = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_dd_blocksize = 1M {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_name_template = volume-%s {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_service_inithost_offload = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volume_usage_audit_period = month {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] zoning_mode = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.auth_section = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.auth_type = password {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.auth_version = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.cache = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.certfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.include_service_catalog = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.insecure = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.interface = public {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.keyfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_password = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcache_username = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.region_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.service_type = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.183/identity {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.backend = dogpile.cache.null {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.backend_argument = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.backend_expiration_time = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.config_prefix = cache.oslo {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.debug_cache_backend = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.enable_retry_client = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.enable_socket_keepalive = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.expiration_time = 600 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.memcache_dead_retry = 300 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.memcache_pool_maxsize = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.memcache_sasl_enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.password = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.proxies = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.redis_db = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.redis_server = localhost:6379 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.retry_attempts = 2 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.retry_delay = 0.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.socket_keepalive_count = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.socket_keepalive_idle = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.socket_keepalive_interval = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.socket_timeout = 1.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.tls_allowed_ciphers = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.tls_cafile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.tls_certfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.tls_enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.tls_keyfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cache.username = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] coordination.backend_url = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.asyncio_connection = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.asyncio_slave_connection = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.backend = sqlalchemy {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.connection = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.connection_debug = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.connection_parameters = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.connection_recycle_time = 3600 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.connection_trace = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.db_inc_retry_interval = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.db_max_retries = 20 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.db_max_retry_interval = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:00 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.db_retry_interval = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.max_overflow = 50 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.max_pool_size = 5 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.max_retries = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.pool_timeout = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.retry_interval = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.slave_connection = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.sqlite_synchronous = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.synchronous_reader = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] database.use_db_reconnect = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_tracing.insecure = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.connection_string = messaging:// {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.es_doc_type = notification {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.es_scroll_size = 10000 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.es_scroll_time = 2m {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.filter_error_trace = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.hmac_keys = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.sentinel_service_name = mymaster {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.socket_timeout = 0.1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.trace_requests = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler.trace_sqlalchemy = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler_jaeger.process_tags = {} {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] profiler_otlp.service_name_prefix = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.policy_default_rule = default {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.policy_file = policy.yaml {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] privsep_osbrick.group = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] privsep_osbrick.helper_command = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] privsep_osbrick.user = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_sys_admin.group = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_sys_admin.helper_command = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] cinder_sys_admin.user = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.auth_section = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.auth_type = password {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.cafile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.certfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.collect_timing = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.insecure = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.keyfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.send_service_user_token = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.split_loggers = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.timeout = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.tls_ciphers = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] service_user.tls_min_version = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.auth_section = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.auth_type = password {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.certfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.collect_timing = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.insecure = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.keyfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.region_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.split_loggers = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.timeout = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.tls_ciphers = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] glance.tls_min_version = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.backend_availability_zone = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.chap_password = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.chap_username = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.disk_geometry = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.driver_client_cert = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.driver_client_cert_key = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.driver_data_namespace = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.driver_use_ssl = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.extra_capabilities = {} {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.filter_function = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.goodness_function = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.iscsi_target_flags = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.iscsi_write_cache = on {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.iser_helper = tgtadm {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.iser_ip_address = 192.168.122.183 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.iser_port = 3260 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.lvm_share_target = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.lvm_type = auto {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.num_shell_tries = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.replication_device = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.report_discard_supported = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.reserved_percentage = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.target_helper = tgtadm {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.target_ip_address = 192.168.122.183 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.target_port = 3260 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.target_protocol = iscsi {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.trace_flags = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.unique_fqdn_network = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.use_chap_auth = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_backend_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_clear = zero {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_clear_ionice = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_clear_size = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_reports.file_event_handler = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_reports.log_dir = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.backend_host = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.chap_password = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack sudo[76510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.chap_username = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.disk_geometry = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.driver_client_cert = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.extra_capabilities = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.filter_function = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.goodness_function = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.iser_helper = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.iser_ip_address = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.iser_port = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack sudo[76510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.lvm_share_target = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.lvm_type = auto {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.num_shell_tries = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.replication_device = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.report_discard_supported = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.reserved_percentage = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.scst_target_driver = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.storage_protocol = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.target_helper = lioadm {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.target_ip_address = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.target_port = 3260 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.trace_flags = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.use_chap_auth = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_clear = zero {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_clear_size = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] lvmdriver-1.volumes_dir = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.ssl = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_notifications.driver = [] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] key_manager.fixed_key = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.barbican_api_version = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.barbican_endpoint = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.barbican_endpoint_type = public {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.barbican_region_name = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.cafile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.certfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.collect_timing = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.insecure = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.keyfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.number_of_retries = 60 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.retry_delay = 1 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.send_service_user_token = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.split_loggers = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.timeout = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.tls_ciphers = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.tls_min_version = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.verify_ssl = True {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican.verify_ssl_path = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.auth_section = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.auth_type = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.cafile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.certfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.collect_timing = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.insecure = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.keyfile = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.split_loggers = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.timeout = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.tls_ciphers = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] barbican_service_user.tls_min_version = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.approle_role_id = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.approle_secret_id = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.auth_method = approle {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.auth_path = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.kv_mountpoint = secret {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.kv_path = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.kv_version = 2 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.namespace = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.root_token_id = **** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.ssl_ca_crt_file = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.timeout = 60.0 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.token_file = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.token_role = None {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.use_ssl = False {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:26:01 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] ******************************************************************************** {{(pid=76135) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 11:26:01 devstack sudo[76510]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:01 devstack sudo[76618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:01 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:01 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.248s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:26:01 devstack cinder-volume[76470]: INFO cinder.brick.local_dev.lvm [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:01 devstack sudo[76714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:26:01 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:01 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG cinder.brick.local_dev.lvm [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76470) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 11:26:01 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:01 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:01 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.189s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:03 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:03 devstack sudo[77005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:03 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:03 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.339s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:03 devstack sudo[77067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 11:26:03 devstack sudo[77067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:03 devstack sudo[77067]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.379s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:03 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:03 devstack sudo[77070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:26:03 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:04 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:04 devstack sudo[77073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:26:04 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:04 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:04 devstack sudo[77076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:26:04 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:04 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:04 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:04 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.388s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:05 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:05 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:05 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:05 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.342s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:05 devstack cinder-volume[76470]: INFO cinder.volume.drivers.lvm [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:05 devstack sudo[77096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:05 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:05 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG cinder.volume.drivers.lvm [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Updating volume stats {{(pid=76470) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:26:05 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:06 devstack sudo[77099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:26:06 devstack sudo[77099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:06 devstack sudo[77099]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:06 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.380s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:06 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:06 devstack sudo[77102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:26:06 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:06 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:06 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:06 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:06 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:06 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:06 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:06 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:06 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:06 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:26:06 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:07 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:07 devstack cinder-volume[76470]: INFO cinder.volume.driver [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Driver hasn't implemented _init_vendor_properties() Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG cinder.volume.driver [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76470) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG oslo_db.sqlalchemy.engines [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG dbcounter [-] [76470] Writer thread running {{(pid=76470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG cinder.db.api [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Building query based on filter {{(pid=76470) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG cinder.image.image_utils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76470) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 11:26:07 devstack cinder-volume[76470]: INFO cinder.keymgr.migration [None req-01249f84-8038-4451-8d7b-6badb9ae4e68 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG cinder.volume.drivers.lvm [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Updating volume stats {{(pid=76470) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:07 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:26:07 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:07 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:07 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:07 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:26:07 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:08 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:08 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:08 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:08 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:08 devstack sudo[77126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:26:08 devstack sudo[77126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:08 devstack sudo[77126]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG cinder.manager [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Notifying Schedulers of capabilities ... {{(pid=76470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:26:08 devstack cinder-volume[76470]: INFO cinder.volume.manager [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Driver initialization completed successfully. Sep 25 11:26:08 devstack cinder-volume[76470]: INFO cinder.manager [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Initiating service 2 cleanup Sep 25 11:26:08 devstack cinder-volume[76470]: INFO cinder.manager [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Service 2 cleanup completed. Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG cinder.service [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Creating RPC server for service cinder-volume {{(pid=76470) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG cinder.service [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76470) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 11:26:08 devstack cinder-volume[76470]: INFO cinder.volume.manager [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG cinder.volume.drivers.lvm [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Updating volume stats {{(pid=76470) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:26:08 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:08 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:26:08 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:09 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:09 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:09 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:09 devstack sudo[77140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:26:09 devstack sudo[77140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:09 devstack sudo[77140]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:09 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:09 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:09 devstack sudo[77251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:26:09 devstack sudo[77251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:09 devstack sudo[77251]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:09 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.318s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:09 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:26:09 devstack sudo[77254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:26:09 devstack sudo[77254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:26:10 devstack sudo[77254]: pam_unix(sudo:session): session closed for user root Sep 25 11:26:10 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:26:10 devstack cinder-volume[76470]: INFO cinder.volume.manager [None req-83c1530c-22c4-433b-8f34-56eca629202d None None] Driver post RPC initialization completed successfully. Sep 25 11:26:10 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:26:20 devstack cinder-volume[76470]: DEBUG dbcounter [-] [76470] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:26:20 devstack cinder-volume[76470]: DEBUG dbcounter [-] [76470] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:26:48 devstack cinder-volume[76470]: DEBUG oslo_service.periodic_task [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running periodic task VolumeManager._thread_info {{(pid=76470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:26:48 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] thread count: 6 {{(pid=76470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:26:48 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] thread info: [<_MainThread(MainThread, started 128326541262976)>, , , , , ] {{(pid=76470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:27:48 devstack cinder-volume[76470]: DEBUG oslo_service.periodic_task [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:27:48 devstack cinder-volume[76470]: DEBUG cinder.volume.drivers.lvm [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Updating volume stats {{(pid=76470) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:27:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:27:48 devstack sudo[82301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:27:48 devstack sudo[82301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:27:48 devstack sudo[82301]: pam_unix(sudo:session): session closed for user root Sep 25 11:27:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:27:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:27:48 devstack sudo[82304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:27:48 devstack sudo[82304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:27:48 devstack sudo[82304]: pam_unix(sudo:session): session closed for user root Sep 25 11:27:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:27:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:27:49 devstack sudo[82308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:27:49 devstack sudo[82308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:27:49 devstack sudo[82308]: pam_unix(sudo:session): session closed for user root Sep 25 11:27:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:27:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:27:49 devstack sudo[82347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:27:49 devstack sudo[82347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:27:49 devstack sudo[82347]: pam_unix(sudo:session): session closed for user root Sep 25 11:27:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:27:49 devstack cinder-volume[76470]: DEBUG cinder.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Notifying Schedulers of capabilities ... {{(pid=76470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:27:49 devstack cinder-volume[76470]: DEBUG oslo_service.periodic_task [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running periodic task VolumeManager._thread_info {{(pid=76470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:27:49 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] thread count: 6 {{(pid=76470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:27:49 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] thread info: [<_MainThread(MainThread, started 128326541262976)>, , , , , ] {{(pid=76470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:28:20 devstack cinder-volume[76470]: DEBUG dbcounter [-] [76470] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:28:48 devstack cinder-volume[76470]: DEBUG oslo_service.periodic_task [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:28:48 devstack cinder-volume[76470]: DEBUG cinder.volume.drivers.lvm [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Updating volume stats {{(pid=76470) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:28:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:28:48 devstack sudo[83645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:28:48 devstack sudo[83645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:28:48 devstack sudo[83645]: pam_unix(sudo:session): session closed for user root Sep 25 11:28:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:28:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:28:48 devstack sudo[83653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:28:48 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:28:48 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root Sep 25 11:28:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:28:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:28:49 devstack sudo[83662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:28:49 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:28:49 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root Sep 25 11:28:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:28:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:28:49 devstack sudo[83672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:28:49 devstack sudo[83672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:28:49 devstack sudo[83672]: pam_unix(sudo:session): session closed for user root Sep 25 11:28:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:28:49 devstack cinder-volume[76470]: DEBUG cinder.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Notifying Schedulers of capabilities ... {{(pid=76470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:29:48 devstack cinder-volume[76470]: DEBUG oslo_service.periodic_task [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:29:48 devstack cinder-volume[76470]: DEBUG cinder.volume.drivers.lvm [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Updating volume stats {{(pid=76470) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:29:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:29:48 devstack sudo[85142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:29:48 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:29:48 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root Sep 25 11:29:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:29:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:29:48 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:29:48 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:29:48 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Sep 25 11:29:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:29:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:29:48 devstack sudo[85148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:29:48 devstack sudo[85148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:29:49 devstack sudo[85148]: pam_unix(sudo:session): session closed for user root Sep 25 11:29:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:29:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:29:49 devstack sudo[85151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:29:49 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:29:49 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root Sep 25 11:29:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:29:49 devstack cinder-volume[76470]: DEBUG cinder.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Notifying Schedulers of capabilities ... {{(pid=76470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:29:49 devstack cinder-volume[76470]: DEBUG oslo_service.periodic_task [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running periodic task VolumeManager._thread_info {{(pid=76470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:29:49 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] thread count: 6 {{(pid=76470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:29:49 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] thread info: [<_MainThread(MainThread, started 128326541262976)>, , , , , ] {{(pid=76470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:30:20 devstack cinder-volume[76470]: DEBUG dbcounter [-] [76470] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:30:45 devstack cinder-volume[76135]: INFO oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Caught SIGTERM, stopping children Sep 25 11:30:45 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Acquiring lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:30:45 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Acquired lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:30:45 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Releasing lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:30:45 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Stop services. {{(pid=76135) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 11:30:45 devstack cinder-volume[76135]: DEBUG oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Killing children. {{(pid=76135) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 11:30:45 devstack cinder-volume[76135]: INFO oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Waiting on 1 children to exit Sep 25 11:30:48 devstack cinder-volume[76470]: DEBUG oslo_service.periodic_task [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:30:48 devstack cinder-volume[76470]: DEBUG cinder.volume.drivers.lvm [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Updating volume stats {{(pid=76470) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:30:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:48 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:30:48 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:48 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:48 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:48 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:30:48 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:49 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:49 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:30:49 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:49 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:49 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:30:49 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:49 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG cinder.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Notifying Schedulers of capabilities ... {{(pid=76470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_service.periodic_task [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] Running periodic task VolumeManager._thread_info {{(pid=76470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] thread count: 5 {{(pid=76470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-e84c12c6-a5af-4c1a-beea-4cd2a150b555 None None] thread info: [<_MainThread(MainThread, started 128326541262976)>, , , , ] {{(pid=76470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Acquiring lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Acquired lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:30:49 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Releasing lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:30:49 devstack cinder-volume[76470]: WARNING amqp [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 11:30:49 devstack cinder-volume[76470]: WARNING amqp [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 11:30:49 devstack cinder-volume[76135]: INFO oslo_service.backend._eventlet.service [None req-6234d1d1-9055-4f9c-9277-dfe6365e75c1 None None] Child 76470 exited with status 0 Sep 25 11:30:50 devstack cinder-volume[86381]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 11:30:50 devstack cinder-volume[86381]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 11:30:50 devstack cinder-volume[86381]: we strongly recommend against using it for new projects. Sep 25 11:30:50 devstack cinder-volume[86381]: If you are already using Eventlet, we recommend migrating to a different Sep 25 11:30:50 devstack cinder-volume[86381]: framework. For more detail see Sep 25 11:30:50 devstack cinder-volume[86381]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 11:30:50 devstack cinder-volume[86381]: import eventlet # noqa Sep 25 11:30:52 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:30:52 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:30:52 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:30:53 devstack cinder-volume[86381]: INFO dbcounter [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Registered counter for database cinder Sep 25 11:30:53 devstack cinder-volume[86381]: DEBUG oslo_db.sqlalchemy.engines [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:30:53 devstack cinder-volume[86381]: DEBUG dbcounter [-] [86381] Writer thread running {{(pid=86381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:30:53 devstack cinder-volume[86381]: INFO cinder.rpc [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 11:30:53 devstack cinder-volume[86381]: INFO cinder.rpc [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 11:30:53 devstack cinder-volume[86381]: DEBUG oslo_db.sqlalchemy.engines [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:30:53 devstack cinder-volume[86381]: INFO cinder.volume.manager [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Determined volume DB was empty at startup. Sep 25 11:30:53 devstack cinder-volume[86381]: DEBUG cinder.volume.manager [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86381) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 11:30:53 devstack cinder-volume[86381]: INFO cinder.volume.manager [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 11:30:53 devstack cinder-volume[86381]: WARNING stevedore.named [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 11:30:53 devstack cinder-volume[86381]: WARNING castellan.key_manager [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:30:53 devstack cinder-volume[86381]: WARNING cinder.keymgr.conf_key_mgr [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:30:53 devstack cinder-volume[86381]: INFO cinder.volume.manager [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_db.sqlalchemy.engines [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:30:54 devstack cinder-volume[86381]: INFO oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Starting 1 workers Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Started child 86691 {{(pid=86381) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Full set of CONF: {{(pid=86381) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] ******************************************************************************** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Configuration options gathered from: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 11:30:54 devstack cinder-volume[86691]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] ================================================================================ {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] allow_availability_zone_fallback = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] allow_compression_on_image_upload = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] allowed_direct_url_schemes = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] api_rate_limit = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] auth_strategy = keystone {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_availability_zone = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_host = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_stats_polling_interval = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backup_api_class = cinder.backup.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backup_name_template = backup-%s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backup_use_same_host = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backup_use_temp_snapshot = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] chap_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] chap_username = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_internal_tenant_project_id = 76a97016647c4103ba0fa4befbad8109 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_internal_tenant_user_id = 2316a7862bc64e509173b6fdcca9ac48 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cluster = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] compression_format = gzip {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] compute_api_class = cinder.compute.nova.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] config_dir = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] config_source = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] control_exchange = openstack {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] debug = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] default_availability_zone = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] default_group_type = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] default_volume_type = QuobyteHD {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] disk_geometry = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] driver_client_cert = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] driver_client_cert_key = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] driver_data_namespace = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] driver_ssl_cert_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] driver_ssl_cert_verify = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] driver_use_ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] enable_new_services = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] enable_unsupported_driver = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] enabled_backends = ['QuobyteHD'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] enforce_multipath_for_image_xfer = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] filter_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_api_insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_api_servers = ['http://192.168.122.183/image'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_api_ssl_compression = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_ca_certificates_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_catalog_info = image:glance:publicURL {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86691]: INFO cinder.volume.manager [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 11:30:54 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.remotefs [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86691) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_num_retries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance_request_timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] goodness_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] graceful_shutdown_timeout = 5 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] group_api_class = cinder.group.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] host = devstack {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_compress_on_upload = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_conversion_address_space_limit = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_conversion_cpu_limit = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_conversion_disable = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_introspection_address_space_limit = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_introspection_cpu_limit = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_upload_use_cinder_backend = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_upload_use_internal_tenant = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_volume_cache_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_volume_cache_max_count = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] image_volume_cache_max_size_gb = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] init_host_max_objects_retrieval = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] instance_format = [instance: %(uuid)s] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] iscsi_target_flags = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] iscsi_write_cache = on {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] iser_helper = tgtadm {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] iser_ip_address = 192.168.122.183 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] iser_port = 3260 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_color = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_config_append = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_dir = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_options = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_rotate_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_rotate_interval_type = days {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] log_rotation_type = none {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] max_age = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] max_logfile_count = 30 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] max_logfile_size_mb = 200 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] max_over_subscription_ratio = 20.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] message_reap_interval = 86400 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] message_ttl = 2592000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] migration_create_volume_timeout_secs = 300 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] monkey_patch = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] monkey_patch_modules = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] my_ip = 192.168.122.183 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] no_snapshot_gb_quota = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] num_iser_scan_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] num_shell_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] num_volume_device_scan_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] nvmeof_conn_info_version = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] nvmet_ns_id = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] nvmet_port_id = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] osapi_max_limit = 1000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] osapi_volume_ext_list = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] osapi_volume_listen_port = 8776 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] osapi_volume_use_ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] osapi_volume_workers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] per_volume_size_limit = -1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] periodic_fuzzy_delay = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] periodic_interval = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] public_endpoint = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] publish_errors = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] quota_backup_gigabytes = 1000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] quota_backups = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] quota_gigabytes = 1000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] quota_groups = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] quota_snapshots = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] quota_volumes = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] rate_limit_burst = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] rate_limit_except_level = CRITICAL {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] rate_limit_interval = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] reinit_driver_count = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] replication_device = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] report_discard_supported = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] report_interval = 120 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] reservation_clean_interval = 86400 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] reservation_expire = 86400 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] reserved_image_namespaces = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] reserved_percentage = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] rpc_response_timeout = 120 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] run_external_periodic_tasks = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] scst_target_driver = iscsi {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] scst_target_iqn_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_down_time = 720 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] shell_completion = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] snapshot_name_template = snapshot-%s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] state_path = /opt/stack/data/cinder {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] storage_availability_zone = nova {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] storage_protocol = iSCSI {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] syslog_log_facility = LOG_USER {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] target_helper = lioadm {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] target_ip_address = 192.168.122.183 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] target_port = 3260 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] target_protocol = iscsi {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] target_secondary_ip_addresses = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] trace_flags = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] transport_url = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] until_refresh = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] use_chap_auth = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86691) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 11:30:54 devstack cinder-volume[86691]: WARNING cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 11:30:54 devstack cinder-volume[86691]: WARNING cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] use_default_quota_class = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] use_journal = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] use_json = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] use_multipath_for_image_xfer = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] use_stderr = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] use_syslog = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] verify_glance_signatures = enabled {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_api_class = cinder.volume.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_backend_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_clear = zero {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_clear_ionice = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_clear_size = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_copy_bps_limit = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_dd_blocksize = 1M {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_name_template = volume-%s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_service_inithost_offload = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volume_usage_audit_period = month {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] zoning_mode = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_concurrency.disable_process_locking = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.auth_section = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.auth_type = password {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.auth_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.cache = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.include_service_catalog = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.interface = public {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcache_username = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.region_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.service_type = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.183/identity {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.backend = dogpile.cache.null {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.backend_argument = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.backend_expiration_time = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.config_prefix = cache.oslo {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.debug_cache_backend = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.enable_retry_client = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.enable_socket_keepalive = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.expiration_time = 600 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.hashclient_retry_attempts = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.memcache_dead_retry = 300 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.memcache_pool_maxsize = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.memcache_sasl_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.proxies = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.redis_db = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.redis_server = localhost:6379 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.retry_attempts = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.retry_delay = 0.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.socket_keepalive_count = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.socket_keepalive_idle = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.socket_keepalive_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.socket_timeout = 1.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.tls_allowed_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.tls_cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.tls_certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.tls_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.tls_keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cache.username = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] coordination.backend_url = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.asyncio_connection = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.asyncio_slave_connection = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.backend = sqlalchemy {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.connection = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.connection_debug = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.connection_parameters = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.connection_recycle_time = 3600 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.connection_trace = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.db_inc_retry_interval = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.db_max_retries = 20 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.db_max_retry_interval = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.db_retry_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.max_overflow = 50 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.max_pool_size = 5 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.max_retries = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.mysql_wsrep_sync_wait = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.pool_timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.retry_interval = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.slave_connection = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.sqlite_synchronous = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.synchronous_reader = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] database.use_db_reconnect = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_tracing.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.connection_string = messaging:// {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.es_doc_type = notification {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.es_scroll_size = 10000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.es_scroll_time = 2m {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.filter_error_trace = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.hmac_keys = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.sentinel_service_name = mymaster {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.socket_timeout = 0.1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.trace_requests = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler.trace_sqlalchemy = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler_jaeger.process_tags = {} {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler_jaeger.service_name_prefix = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] profiler_otlp.service_name_prefix = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.enforce_new_defaults = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.policy_default_rule = default {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.policy_file = policy.yaml {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] privsep_osbrick.group = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] privsep_osbrick.helper_command = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] privsep_osbrick.user = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_sys_admin.group = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_sys_admin.helper_command = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] cinder_sys_admin.user = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.auth_section = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.auth_type = password {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.collect_timing = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.send_service_user_token = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.tls_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] service_user.tls_min_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.auth_section = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.auth_type = password {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.collect_timing = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.region_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.tls_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] glance.tls_min_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.backend_availability_zone = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.chap_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.chap_username = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.disk_geometry = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.driver_client_cert = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.driver_client_cert_key = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.driver_data_namespace = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.driver_use_ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.extra_capabilities = {} {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.filter_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.goodness_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.iscsi_target_flags = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.iscsi_write_cache = on {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.iser_helper = tgtadm {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.iser_ip_address = 192.168.122.183 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.iser_port = 3260 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_host = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_login = admin {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack quobyte-client[86702]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_mount_options = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_private_key = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_share_path = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack quobyte-client[86702]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.num_shell_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] CMD "mount.quobyte" returned: 1 in 0.176s {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.quobyte_volume_url = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:30:54 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:30:54 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=86691) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.replication_device = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.report_discard_supported = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86691]: INFO cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 ... Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.reserved_percentage = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b -c /etc/quobyte/client-cinder.cfg {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.target_helper = tgtadm {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.target_ip_address = 192.168.122.183 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.target_port = 3260 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.target_protocol = iscsi {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.trace_flags = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.unique_fqdn_network = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.use_chap_auth = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volume_backend_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volume_clear = zero {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volume_clear_ionice = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volume_clear_size = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_reports.file_event_handler = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_reports.log_dir = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.backend_availability_zone = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.backend_host = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.chap_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.chap_username = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.chiscsi_conf = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.disk_geometry = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.driver_client_cert = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.driver_data_namespace = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.driver_use_ssl = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.extra_capabilities = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.filter_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.goodness_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.iser_helper = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.iser_ip_address = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.iser_port = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.iser_target_prefix = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_host = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_login = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_mount_options = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_private_key = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_share_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_ssh_port = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.num_shell_tries = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.nvmet_port_id = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.replication_device = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.report_discard_supported = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.reserved_percentage = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.scst_target_driver = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.storage_protocol = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.target_helper = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.target_ip_address = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b -c /etc/quobyte/client-cinder.cfg Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.target_port = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.target_prefix = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.target_protocol = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.trace_flags = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.use_chap_auth = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volume_clear = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volume_clear_size = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] QuobyteHD.volumes_dir = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_notifications.driver = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_notifications.retry = -1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] key_manager.fixed_key = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.barbican_api_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.barbican_endpoint = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.barbican_endpoint_type = public {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.barbican_region_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.collect_timing = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.number_of_retries = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.retry_delay = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.send_service_user_token = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.tls_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.tls_min_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.verify_ssl = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican.verify_ssl_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.auth_section = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.auth_type = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.collect_timing = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.tls_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] barbican_service_user.tls_min_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.approle_role_id = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.approle_secret_id = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.auth_method = approle {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.auth_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.kv_mountpoint = secret {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.kv_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.kv_version = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.namespace = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.root_token_id = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.ssl_ca_crt_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.timeout = 60.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.token_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.token_role = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.use_ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:54 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] ******************************************************************************** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 11:30:55 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.527s {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:55 devstack cinder-volume[86691]: INFO cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 succeeded Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=86691) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.544s {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:55 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:30:55 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:55 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.295s {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:55 devstack cinder-volume[86691]: INFO cinder.volume.driver [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.volume.driver [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.434913635254, 'free_capacity_gb': 1775.434913635254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86691) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_db.sqlalchemy.engines [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86691) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG dbcounter [-] [86691] Writer thread running {{(pid=86691) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.db.api [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Building query based on filter {{(pid=86691) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.image.image_utils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86691) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 11:30:55 devstack cinder-volume[86691]: INFO cinder.keymgr.migration [None req-5b36070c-8c34-4824-a8dd-44c232bfec02 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=86691) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=86691) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:55 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:30:55 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:55 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.261s {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.manager [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Notifying Schedulers of capabilities ... {{(pid=86691) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:30:55 devstack cinder-volume[86691]: INFO cinder.volume.manager [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Driver initialization completed successfully. Sep 25 11:30:55 devstack cinder-volume[86691]: INFO cinder.manager [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Initiating service 3 cleanup Sep 25 11:30:55 devstack cinder-volume[86691]: INFO cinder.manager [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Service 3 cleanup completed. Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.service [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Creating RPC server for service cinder-volume {{(pid=86691) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.service [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86691) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 11:30:55 devstack cinder-volume[86691]: INFO cinder.volume.manager [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=86691) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:30:55 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=86691) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:30:56 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:30:56 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:56 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:30:56 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:56 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:56 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.397s {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:56 devstack cinder-volume[86691]: INFO cinder.volume.manager [None req-83f0f678-4a79-458a-b9b2-2a8530cc80b3 None None] Driver post RPC initialization completed successfully. Sep 25 11:31:01 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-60191961-9875-4535-85f4-2564cefeaf9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:31:01 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-60191961-9875-4535-85f4-2564cefeaf9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:31:01 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-60191961-9875-4535-85f4-2564cefeaf9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=86691) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:31:01 devstack cinder-volume[86691]: DEBUG cinder.volume.drivers.quobyte [None req-60191961-9875-4535-85f4-2564cefeaf9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=86691) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:31:01 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-60191961-9875-4535-85f4-2564cefeaf9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86691) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:31:01 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-60191961-9875-4535-85f4-2564cefeaf9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:01 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:31:01 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:01 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:01 devstack cinder-volume[86691]: DEBUG oslo_concurrency.processutils [None req-60191961-9875-4535-85f4-2564cefeaf9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.261s {{(pid=86691) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:01 devstack cinder-volume[86691]: DEBUG cinder.manager [None req-60191961-9875-4535-85f4-2564cefeaf9c None None] Notifying Schedulers of capabilities ... {{(pid=86691) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:31:04 devstack cinder-volume[86381]: DEBUG dbcounter [-] [86381] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:31:04 devstack cinder-volume[86381]: INFO oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Caught SIGTERM, stopping children Sep 25 11:31:04 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Acquiring lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:31:04 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Acquired lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:31:04 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Releasing lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:31:04 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Stop services. {{(pid=86381) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 11:31:04 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Killing children. {{(pid=86381) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 11:31:04 devstack cinder-volume[86381]: INFO oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Waiting on 1 children to exit Sep 25 11:31:06 devstack cinder-volume[86691]: DEBUG dbcounter [-] [86691] Writing DB stats cinder:SELECT=3 {{(pid=86691) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:31:06 devstack cinder-volume[86691]: DEBUG dbcounter [-] [86691] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86691) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:31:09 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Acquiring lock "singleton_lock" {{(pid=86691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:31:09 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Acquired lock "singleton_lock" {{(pid=86691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:31:09 devstack cinder-volume[86691]: DEBUG oslo_concurrency.lockutils [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Releasing lock "singleton_lock" {{(pid=86691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:31:09 devstack cinder-volume[86691]: WARNING amqp [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 11:31:09 devstack cinder-volume[86691]: WARNING amqp [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 11:31:09 devstack cinder-volume[86381]: INFO oslo_service.backend._eventlet.service [None req-a4c79c7f-64ab-4b68-955b-f7576ab5622b None None] Child 86691 exited with status 0 Sep 25 11:31:09 devstack cinder-volume[87095]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 11:31:09 devstack cinder-volume[87095]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 11:31:09 devstack cinder-volume[87095]: we strongly recommend against using it for new projects. Sep 25 11:31:09 devstack cinder-volume[87095]: If you are already using Eventlet, we recommend migrating to a different Sep 25 11:31:09 devstack cinder-volume[87095]: framework. For more detail see Sep 25 11:31:09 devstack cinder-volume[87095]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 11:31:09 devstack cinder-volume[87095]: import eventlet # noqa Sep 25 11:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:31:14 devstack cinder-volume[87095]: INFO dbcounter [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Registered counter for database cinder Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_db.sqlalchemy.engines [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writer thread running {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:31:14 devstack cinder-volume[87095]: INFO cinder.rpc [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 11:31:14 devstack cinder-volume[87095]: INFO cinder.rpc [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_db.sqlalchemy.engines [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:31:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Determined volume DB was empty at startup. Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87095) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 11:31:14 devstack cinder-volume[87095]: WARNING stevedore.named [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 11:31:14 devstack cinder-volume[87095]: WARNING castellan.key_manager [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:31:14 devstack cinder-volume[87095]: WARNING cinder.keymgr.conf_key_mgr [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:31:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_db.sqlalchemy.engines [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:31:14 devstack cinder-volume[87095]: INFO oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Starting 1 workers Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Started child 87356 {{(pid=87095) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Full set of CONF: {{(pid=87095) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] ******************************************************************************** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] Configuration options gathered from: {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] ================================================================================ {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] allow_availability_zone_fallback = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] allow_compression_on_image_upload = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] allowed_direct_url_schemes = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] api_rate_limit = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87356]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] auth_strategy = keystone {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_availability_zone = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_host = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_stats_polling_interval = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backup_api_class = cinder.backup.api.API {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backup_name_template = backup-%s {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backup_use_same_host = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backup_use_temp_snapshot = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] chap_password = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] chap_username = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_internal_tenant_project_id = 76a97016647c4103ba0fa4befbad8109 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_internal_tenant_user_id = 2316a7862bc64e509173b6fdcca9ac48 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cluster = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] compression_format = gzip {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] compute_api_class = cinder.compute.nova.API {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] config_dir = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] config_source = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] control_exchange = openstack {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] debug = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] default_availability_zone = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] default_group_type = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] default_volume_type = QuobyteHD {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] disk_geometry = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] driver_client_cert = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] driver_client_cert_key = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] driver_data_namespace = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] driver_ssl_cert_path = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] driver_ssl_cert_verify = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] driver_use_ssl = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] enable_new_services = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] enable_unsupported_driver = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] enabled_backends = ['QuobyteHD'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] enforce_multipath_for_image_xfer = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] filter_function = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_api_insecure = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_api_servers = ['http://192.168.122.183/image'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_api_ssl_compression = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_ca_certificates_file = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_catalog_info = image:glance:publicURL {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_certfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_keyfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_num_retries = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance_request_timeout = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] goodness_function = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] graceful_shutdown_timeout = 5 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] group_api_class = cinder.group.api.API {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] host = devstack {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_compress_on_upload = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_conversion_address_space_limit = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_conversion_cpu_limit = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_conversion_disable = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_introspection_address_space_limit = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_introspection_cpu_limit = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_upload_use_cinder_backend = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_upload_use_internal_tenant = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_volume_cache_enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_volume_cache_max_count = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] image_volume_cache_max_size_gb = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] init_host_max_objects_retrieval = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] instance_format = [instance: %(uuid)s] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] iscsi_target_flags = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] iscsi_write_cache = on {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] iser_helper = tgtadm {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] iser_ip_address = 192.168.122.183 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] iser_port = 3260 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_color = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_config_append = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_dir = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_file = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_options = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_rotate_interval = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_rotate_interval_type = days {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] log_rotation_type = none {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] max_age = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] max_logfile_count = 30 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] max_logfile_size_mb = 200 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] max_over_subscription_ratio = 20.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] message_reap_interval = 86400 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] message_ttl = 2592000 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] migration_create_volume_timeout_secs = 300 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] monkey_patch = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] monkey_patch_modules = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] my_ip = 192.168.122.183 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] no_snapshot_gb_quota = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] num_iser_scan_tries = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] num_shell_tries = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] num_volume_device_scan_tries = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] nvmeof_conn_info_version = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] nvmet_ns_id = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] nvmet_port_id = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] osapi_max_limit = 1000 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] osapi_volume_ext_list = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] osapi_volume_listen = 0.0.0.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] osapi_volume_listen_port = 8776 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] osapi_volume_use_ssl = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] osapi_volume_workers = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] per_volume_size_limit = -1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] periodic_fuzzy_delay = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] periodic_interval = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] project_id_regex = [0-9a-f\-]+ {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] public_endpoint = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] publish_errors = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] quota_backup_gigabytes = 1000 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] quota_backups = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] quota_gigabytes = 1000 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] quota_groups = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] quota_snapshots = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] quota_volumes = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] rate_limit_burst = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] rate_limit_except_level = CRITICAL {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] rate_limit_interval = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] reinit_driver_count = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] replication_device = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] report_discard_supported = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] report_interval = 120 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] reservation_clean_interval = 86400 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] reservation_expire = 86400 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] reserved_image_namespaces = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] reserved_percentage = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] rpc_response_timeout = 120 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] run_external_periodic_tasks = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] scst_target_driver = iscsi {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] scst_target_iqn_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_down_time = 720 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] shell_completion = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] snapshot_name_template = snapshot-%s {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] split_loggers = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] state_path = /opt/stack/data/cinder {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] storage_availability_zone = nova {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] storage_protocol = iSCSI {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] syslog_log_facility = LOG_USER {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] target_helper = lioadm {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] target_ip_address = 192.168.122.183 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] target_port = 3260 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87356) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] target_protocol = iscsi {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] target_secondary_ip_addresses = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] trace_flags = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] transfer_api_class = cinder.transfer.api.API {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] transport_url = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] until_refresh = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] use_chap_auth = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] use_default_quota_class = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] use_journal = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] use_json = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] use_multipath_for_image_xfer = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] use_stderr = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] use_syslog = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] verify_glance_signatures = enabled {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_api_class = cinder.volume.api.API {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_backend_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_clear = zero {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_clear_ionice = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_clear_size = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_copy_bps_limit = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_dd_blocksize = 1M {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_name_template = volume-%s {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_service_inithost_offload = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volume_usage_audit_period = month {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] zoning_mode = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_concurrency.disable_process_locking = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.auth_section = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.auth_type = password {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.auth_version = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.cache = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.certfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.include_service_catalog = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.insecure = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.interface = public {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.keyfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_password = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcache_username = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.region_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.service_type = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.183/identity {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.backend = dogpile.cache.null {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.backend_argument = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.backend_expiration_time = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.config_prefix = cache.oslo {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.debug_cache_backend = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.enable_retry_client = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.enable_socket_keepalive = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.expiration_time = 600 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.hashclient_retry_attempts = 2 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.memcache_dead_retry = 300 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.memcache_pool_maxsize = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.memcache_sasl_enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.password = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.proxies = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.redis_db = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.redis_server = localhost:6379 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.retry_attempts = 2 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.retry_delay = 0.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.socket_keepalive_count = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.socket_keepalive_idle = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.socket_keepalive_interval = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.socket_timeout = 1.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.tls_allowed_ciphers = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.tls_cafile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.tls_certfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.tls_enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.tls_keyfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cache.username = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] coordination.backend_url = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.asyncio_connection = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.asyncio_slave_connection = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.backend = sqlalchemy {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.connection = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.connection_debug = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.connection_parameters = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.connection_recycle_time = 3600 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.connection_trace = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.db_inc_retry_interval = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.db_max_retries = 20 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.db_max_retry_interval = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.db_retry_interval = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.max_overflow = 50 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.max_pool_size = 5 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.max_retries = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.mysql_wsrep_sync_wait = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.pool_timeout = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.retry_interval = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.slave_connection = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.sqlite_synchronous = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.synchronous_reader = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] database.use_db_reconnect = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87356) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_tracing.insecure = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Running cmd (subprocess): mount.quobyte {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.connection_string = messaging:// {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.es_doc_type = notification {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.es_scroll_size = 10000 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.es_scroll_time = 2m {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.filter_error_trace = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.hmac_keys = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.sentinel_service_name = mymaster {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.socket_timeout = 0.1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.trace_requests = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler.trace_sqlalchemy = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler_jaeger.process_tags = {} {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler_jaeger.service_name_prefix = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] profiler_otlp.service_name_prefix = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.enforce_new_defaults = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.policy_default_rule = default {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.policy_file = policy.yaml {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_policy.remote_timeout = 60.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] privsep_osbrick.group = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] privsep_osbrick.helper_command = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] privsep_osbrick.user = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_sys_admin.group = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_sys_admin.helper_command = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] cinder_sys_admin.user = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.auth_section = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.auth_type = password {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.cafile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.certfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.collect_timing = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.insecure = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.keyfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.send_service_user_token = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.split_loggers = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.timeout = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.tls_ciphers = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] service_user.tls_min_version = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.auth_section = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.auth_type = password {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.certfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.collect_timing = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.insecure = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.keyfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.region_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.split_loggers = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.timeout = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.tls_ciphers = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] glance.tls_min_version = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.backend_availability_zone = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.chap_password = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.chap_username = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.disk_geometry = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.driver_client_cert = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.driver_client_cert_key = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.driver_data_namespace = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.driver_use_ssl = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.extra_capabilities = {} {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.filter_function = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.goodness_function = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.iscsi_target_flags = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.iscsi_write_cache = on {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.iser_helper = tgtadm {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.iser_ip_address = 192.168.122.183 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.iser_port = 3260 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_host = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_login = admin {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_mount_options = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_password = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_private_key = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_share_path = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_ssh_port = 22 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.num_shell_tries = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.quobyte_volume_url = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.replication_device = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.report_discard_supported = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.reserved_percentage = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.target_helper = tgtadm {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.target_ip_address = 192.168.122.183 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.target_port = 3260 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:14 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.target_protocol = iscsi {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.trace_flags = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.unique_fqdn_network = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.use_chap_auth = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volume_backend_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volume_clear = zero {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volume_clear_ionice = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volume_clear_size = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_reports.file_event_handler = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_reports.log_dir = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.backend_availability_zone = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.backend_host = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.chap_password = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.chap_username = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.chiscsi_conf = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack quobyte-client[87385]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.disk_geometry = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.driver_client_cert = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack quobyte-client[87385]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.driver_data_namespace = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.driver_use_ssl = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.extra_capabilities = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.filter_function = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.goodness_function = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.iscsi_target_flags = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.iscsi_write_cache = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.iser_helper = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.iser_ip_address = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.iser_port = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.iser_target_prefix = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_host = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_login = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_mount_options = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_password = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_private_key = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_share_path = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_ssh_port = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.num_shell_tries = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nvmet_ns_id = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.nvmet_port_id = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.replication_device = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.report_discard_supported = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.reserved_percentage = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.scst_target_driver = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.storage_protocol = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.target_helper = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.target_ip_address = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.target_port = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.target_prefix = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.target_protocol = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.trace_flags = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.unique_fqdn_network = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.use_chap_auth = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volume_clear = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volume_clear_ionice = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volume_clear_size = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] QuobyteHD.volumes_dir = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.ssl = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.ssl_version = {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_notifications.driver = [] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_notifications.retry = -1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] key_manager.fixed_key = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.barbican_api_version = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.barbican_endpoint = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.barbican_endpoint_type = public {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.barbican_region_name = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.cafile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.certfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.collect_timing = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.insecure = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.keyfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.number_of_retries = 60 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.retry_delay = 1 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.send_service_user_token = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.split_loggers = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.timeout = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.tls_ciphers = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.tls_min_version = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.verify_ssl = True {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican.verify_ssl_path = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.auth_section = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.auth_type = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.cafile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.certfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.collect_timing = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.insecure = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.keyfile = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.split_loggers = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.timeout = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.tls_ciphers = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] barbican_service_user.tls_min_version = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.approle_role_id = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.approle_secret_id = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.auth_method = approle {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:31:15 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.auth_path = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.kv_mountpoint = secret {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.kv_path = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.kv_version = 2 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.namespace = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.root_token_id = **** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.ssl_ca_crt_file = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.timeout = 60.0 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.token_file = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.token_role = None {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.use_ssl = False {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:31:15 devstack cinder-volume[87095]: DEBUG oslo_service.backend._eventlet.service [None req-d9db425b-dc11-4c53-84c7-194151bdb61f None None] ******************************************************************************** {{(pid=87095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 11:31:15 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.278s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:15 devstack cinder-volume[87356]: INFO cinder.volume.driver [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Driver hasn't implemented _init_vendor_properties() Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.volume.driver [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.434913635254, 'free_capacity_gb': 1775.434913635254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87356) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_db.sqlalchemy.engines [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87356) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writer thread running {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.db.api [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Building query based on filter {{(pid=87356) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87356) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:15 devstack cinder-volume[87356]: INFO cinder.keymgr.migration [None req-c68a3969-b184-4c9e-b45e-8f06085c2b49 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 11:31:15 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:31:15 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:15 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.242s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:31:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Driver initialization completed successfully. Sep 25 11:31:15 devstack cinder-volume[87356]: INFO cinder.manager [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Initiating service 3 cleanup Sep 25 11:31:15 devstack cinder-volume[87356]: INFO cinder.manager [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Service 3 cleanup completed. Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.service [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Creating RPC server for service cinder-volume {{(pid=87356) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.service [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87356) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 11:31:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:31:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:15 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:31:15 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:16 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.245s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0cebe4c4-dfe7-481b-9c2e-560cef84012d None None] Driver post RPC initialization completed successfully. Sep 25 11:31:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:31:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 6 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:31:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:31:24 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:31:25 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:31:26 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:23 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:32:23 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:23 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.549s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 6 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:32:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Flow 'volume_create_manager' (2d14cae2-42ce-4013-8c77-0bd97e140e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc47e41a-57bb-4fd9-9a17-fd48697c5b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc47e41a-57bb-4fd9-9a17-fd48697c5b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-162720094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c366a0f8-90be-415d-8515-048eabafbe6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902d0d1ae5474a7a8056894731ac0cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:32:39Z,use_quota=True,user_id='9124ebd99e884bcc8eb1ddf89f35d836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dce062-114c-44db-a4c2-838a29ef2de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dce062-114c-44db-a4c2-838a29ef2de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe69d1e-c7d8-4f4f-adbe-304e05f04ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe69d1e-c7d8-4f4f-adbe-304e05f04ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c366a0f8-90be-415d-8515-048eabafbe6e', 'volume_name': 'volume-c366a0f8-90be-415d-8515-048eabafbe6e', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c37859-a68a-48f7-95c7-e5b3f7cc2955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c37859-a68a-48f7-95c7-e5b3f7cc2955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55adf430-d7c1-428d-aba7-e8150f8489c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:39 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Volume c366a0f8-90be-415d-8515-048eabafbe6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c366a0f8-90be-415d-8515-048eabafbe6e', 'volume_size': 1} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-162720094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c366a0f8-90be-415d-8515-048eabafbe6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902d0d1ae5474a7a8056894731ac0cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:32:39Z,use_quota=True,user_id='9124ebd99e884bcc8eb1ddf89f35d836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Creating volume c366a0f8-90be-415d-8515-048eabafbe6e {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:32:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:32:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:32:40 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:32:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:40 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e 1073741824 Sep 25 11:32:40 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:41 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e 1073741824" returned: 0 in 1.491s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:41 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e Sep 25 11:32:41 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:42 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e" returned: 0 in 0.808s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] <== create_volume: return (2464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:32:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.473s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55adf430-d7c1-428d-aba7-e8150f8489c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c366a0f8-90be-415d-8515-048eabafbe6e', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814c24c9-a525-4e1f-80c7-dc6ab3e4e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Volume volume-c366a0f8-90be-415d-8515-048eabafbe6e (c366a0f8-90be-415d-8515-048eabafbe6e): created successfully Sep 25 11:32:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814c24c9-a525-4e1f-80c7-dc6ab3e4e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Flow 'volume_create_manager' (2d14cae2-42ce-4013-8c77-0bd97e140e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:32:42 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f7e1ce7d-9174-4fa1-8c02-39def4c93f22 tempest-DeleteServersTestJSON-1194284694 None] Created volume successfully. Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Flow 'volume_create_manager' (3a436d49-9406-4c9d-b96b-44168a123a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11dee9b-b5fe-4dbd-8c47-46e4350372b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11dee9b-b5fe-4dbd-8c47-46e4350372b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-859959078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d39e07-d18b-44c9-b507-c805d1df9fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65821cf7d5148e5a9b575b02038edf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:32:45Z,use_quota=True,user_id='48aae462373d48dc9024f58462d9d41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee5ae55-9bc5-4294-86c6-e54eaaa65a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee5ae55-9bc5-4294-86c6-e54eaaa65a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a2e638-8e40-410f-b6eb-5c3305794b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a2e638-8e40-410f-b6eb-5c3305794b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d39e07-d18b-44c9-b507-c805d1df9fd7', 'volume_name': 'volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab21dcd6-2ac8-4325-b3fb-c3c200709389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab21dcd6-2ac8-4325-b3fb-c3c200709389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd56eb60-5c62-43c0-8d8e-513a0028a119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:45 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Volume a3d39e07-d18b-44c9-b507-c805d1df9fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7', 'volume_size': 1} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-859959078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d39e07-d18b-44c9-b507-c805d1df9fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65821cf7d5148e5a9b575b02038edf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:32:45Z,use_quota=True,user_id='48aae462373d48dc9024f58462d9d41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Creating volume a3d39e07-d18b-44c9-b507-c805d1df9fd7 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:32:45 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:32:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:45 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 1073741824 Sep 25 11:32:45 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:46 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 1073741824" returned: 0 in 1.247s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:46 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 Sep 25 11:32:46 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:47 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7" returned: 0 in 0.576s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:32:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd56eb60-5c62-43c0-8d8e-513a0028a119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cccac4a-df2e-41e0-bf9d-9079e0a0abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:47 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Volume volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 (a3d39e07-d18b-44c9-b507-c805d1df9fd7): created successfully Sep 25 11:32:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cccac4a-df2e-41e0-bf9d-9079e0a0abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Flow 'volume_create_manager' (3a436d49-9406-4c9d-b96b-44168a123a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:32:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4b422f45-3072-49a0-a4f7-1e7f0880d497 tempest-VolumesAdminNegativeTest-1711600824 None] Created volume successfully. Sep 25 11:32:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Acquiring lock "cinder-a3d39e07-d18b-44c9-b507-c805d1df9fd7-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:32:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Lock "cinder-a3d39e07-d18b-44c9-b507-c805d1df9fd7-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:32:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Acquiring lock "cinder-quobyte-a3d39e07-d18b-44c9-b507-c805d1df9fd7" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:32:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Lock "cinder-quobyte-a3d39e07-d18b-44c9-b507-c805d1df9fd7" acquired by "delete_volume" :: waited 0.051s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:32:49 devstack cinder-volume[87356]: INFO oslo.privsep.daemon [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjzg1zuev/privsep.sock'] Sep 25 11:32:49 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjzg1zuev/privsep.sock Sep 25 11:32:49 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING py.warnings [req-8e2756e9-379a-4957-b4b2-04609ad048bc req-e0f0c6f4-f209-4773-bb30-120dcef6bc3b tempest-DeleteServersTestJSON-1194284694 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 25 11:32:51 devstack cinder-volume[87356]: .first() Sep 25 11:32:51 devstack cinder-volume[87356]: Sep 25 11:32:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8e2756e9-379a-4957-b4b2-04609ad048bc req-e0f0c6f4-f209-4773-bb30-120dcef6bc3b tempest-DeleteServersTestJSON-1194284694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8e2756e9-379a-4957-b4b2-04609ad048bc req-e0f0c6f4-f209-4773-bb30-120dcef6bc3b tempest-DeleteServersTestJSON-1194284694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8e2756e9-379a-4957-b4b2-04609ad048bc req-e0f0c6f4-f209-4773-bb30-120dcef6bc3b tempest-DeleteServersTestJSON-1194284694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.070s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 11:32:51 devstack cinder-volume[87356]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 11:32:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8e2756e9-379a-4957-b4b2-04609ad048bc req-e0f0c6f4-f209-4773-bb30-120dcef6bc3b tempest-DeleteServersTestJSON-1194284694 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-c366a0f8-90be-415d-8515-048eabafbe6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e6af8ec-0053-4372-87ba-3042dbe15857', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:32:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-8e2756e9-379a-4957-b4b2-04609ad048bc req-e0f0c6f4-f209-4773-bb30-120dcef6bc3b tempest-DeleteServersTestJSON-1194284694 None] attachment_update completed successfully. Sep 25 11:32:52 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:52 devstack cinder-volume[87356]: INFO oslo.privsep.daemon [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Spawned new privsep daemon via rootwrap Sep 25 11:32:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Accepted privsep connection to /tmp/tmpjzg1zuev/privsep.sock {{(pid=87356) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 11:32:52 devstack cinder-volume[87356]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 11:32:52 devstack cinder-volume[87356]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 11:32:52 devstack cinder-volume[87356]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 11:32:52 devstack cinder-volume[87356]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88547 Sep 25 11:32:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8361b38-94bd-4741-b9a1-3b183775e3ec]: (2,) {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:32:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98bbe2d-cf3e-46f0-9729-c596db5bb288]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:32:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:52 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 Sep 25 11:32:52 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:53 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7" returned: 0 in 1.113s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:53 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7 Sep 25 11:32:53 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:53 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:32:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Flow 'volume_create_manager' (0295ebe2-6dc6-42af-9475-18001f71edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:32:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072b03ff-2cd3-4401-adeb-fb6bcd3ad22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072b03ff-2cd3-4401-adeb-fb6bcd3ad22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1420643287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37540cc-95b2-4957-88ea-65d654610767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8d33a6905c4676a8d62a1a35758940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:32:54Z,use_quota=True,user_id='99a1f135fc9e47a98a8ddfd1a73c0950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef02632a-1966-47d1-b81f-9fe77c405689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef02632a-1966-47d1-b81f-9fe77c405689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291734f3-ee7d-40e0-ba00-e3c11e9961e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291734f3-ee7d-40e0-ba00-e3c11e9961e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd37540cc-95b2-4957-88ea-65d654610767', 'volume_name': 'volume-d37540cc-95b2-4957-88ea-65d654610767', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bf1ec0-e01b-4036-9d88-05ace905b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bf1ec0-e01b-4036-9d88-05ace905b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6920fd-0a7b-45dc-b138-92b78433721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:54 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Volume d37540cc-95b2-4957-88ea-65d654610767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d37540cc-95b2-4957-88ea-65d654610767', 'volume_size': 1} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1420643287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37540cc-95b2-4957-88ea-65d654610767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8d33a6905c4676a8d62a1a35758940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:32:54Z,use_quota=True,user_id='99a1f135fc9e47a98a8ddfd1a73c0950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Creating volume d37540cc-95b2-4957-88ea-65d654610767 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:32:54 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:54 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 1073741824 Sep 25 11:32:54 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:54 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3d39e07-d18b-44c9-b507-c805d1df9fd7" returned: 0 in 0.747s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Lock "cinder-quobyte-a3d39e07-d18b-44c9-b507-c805d1df9fd7" released by "delete_volume" :: held 4.811s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:32:54 devstack cinder-volume[87356]: WARNING cinder.quota [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:32:54 devstack cinder-volume[87356]: WARNING cinder.quota [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Created reservations ['63d3ce6a-f854-4810-bc22-1612f49722da', '109f4b5a-a2fc-4355-a073-160b09dfd010', 'b7b81352-a626-46c6-8807-07fe8f9ea088', 'cd8d4ee0-46aa-4c50-8d8e-077b46dcdb70'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:54 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:32:54 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:55 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 1073741824" returned: 0 in 1.305s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:55 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 Sep 25 11:32:55 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.862s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:55 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:55 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:32:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Deleted volume successfully. Sep 25 11:32:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0d254d46-8a0a-4c53-a405-10cc4bf1bf2b tempest-VolumesAdminNegativeTest-1711600824 None] Lock "cinder-a3d39e07-d18b-44c9-b507-c805d1df9fd7-delete_volume" released by "delete_volume" :: held 6.579s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:32:56 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767" returned: 0 in 0.795s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:32:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:32:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6920fd-0a7b-45dc-b138-92b78433721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37540cc-95b2-4957-88ea-65d654610767', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dd0164-d887-4928-9e87-b82f7ae1eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:32:56 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Volume volume-d37540cc-95b2-4957-88ea-65d654610767 (d37540cc-95b2-4957-88ea-65d654610767): created successfully Sep 25 11:32:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dd0164-d887-4928-9e87-b82f7ae1eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:32:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Flow 'volume_create_manager' (0295ebe2-6dc6-42af-9475-18001f71edc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:32:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-29adff30-9e0a-46b1-b28f-84fd210efe25 tempest-ServerRescueNegativeTestJSON-1162216136 None] Created volume successfully. Sep 25 11:33:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-d6de8794-9490-4d28-8ffb-e20f98cf71cc req-2476e7f7-f067-4a6f-8a9c-670d6839b7e1 tempest-DeleteServersTestJSON-1194284694 None] Terminate volume connection completed successfully. Sep 25 11:33:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-d6de8794-9490-4d28-8ffb-e20f98cf71cc req-2476e7f7-f067-4a6f-8a9c-670d6839b7e1 tempest-DeleteServersTestJSON-1194284694 None] Deleting attachment 8e6af8ec-0053-4372-87ba-3042dbe15857. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:33:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Acquiring lock "cinder-c366a0f8-90be-415d-8515-048eabafbe6e-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Lock "cinder-c366a0f8-90be-415d-8515-048eabafbe6e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Acquiring lock "cinder-quobyte-c366a0f8-90be-415d-8515-048eabafbe6e" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Lock "cinder-quobyte-c366a0f8-90be-415d-8515-048eabafbe6e" acquired by "delete_volume" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a971ee-07ae-4ef7-b7d3-fdeb7f570cae]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:33:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:02 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e Sep 25 11:33:02 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:02 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e" returned: 0 in 0.509s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:02 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e Sep 25 11:33:02 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:03 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c366a0f8-90be-415d-8515-048eabafbe6e" returned: 0 in 0.442s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Lock "cinder-quobyte-c366a0f8-90be-415d-8515-048eabafbe6e" released by "delete_volume" :: held 1.031s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Created reservations ['e8b3c5a7-703e-487d-9e61-e113fea997ad', '768c4d2f-8025-4ad6-8311-b4ef26262dd1', 'bf80b443-c281-4604-83b9-3e388ca05c53', '2202b60c-6690-4658-a5e7-a5f28a9d19b2'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:03 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:33:03 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:03 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.396s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:03 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:33:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Deleted volume successfully. Sep 25 11:33:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88da598c-ede5-464a-8c7f-a9b58230d94e tempest-DeleteServersTestJSON-1194284694 None] Lock "cinder-c366a0f8-90be-415d-8515-048eabafbe6e-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:13 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=22,cinder:INSERT=3,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:33:14 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=25,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:23 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:33:23 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:23 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.268s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:33:26 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:33:26 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:33:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Acquiring lock "cinder-d37540cc-95b2-4957-88ea-65d654610767-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "cinder-d37540cc-95b2-4957-88ea-65d654610767-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Acquiring lock "cinder-quobyte-d37540cc-95b2-4957-88ea-65d654610767" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "cinder-quobyte-d37540cc-95b2-4957-88ea-65d654610767" acquired by "delete_volume" :: waited 0.061s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:26 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2170fb7-cba0-41a0-945a-cea0628235b2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:33:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:26 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 Sep 25 11:33:26 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:27 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767" returned: 0 in 0.521s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:27 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767 Sep 25 11:33:27 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:27 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d37540cc-95b2-4957-88ea-65d654610767" returned: 0 in 0.410s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "cinder-quobyte-d37540cc-95b2-4957-88ea-65d654610767" released by "delete_volume" :: held 1.021s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Created reservations ['4ba0acaf-f942-4b78-b864-315703ef3f11', '2f790caa-8fe8-4827-801f-8e51c276876d', '7097acaf-272c-45b3-b100-4339ec1447c1', '1be5d27c-3955-4e94-88b8-3ac4d539dde4'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:27 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:33:27 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:28 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.365s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:28 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:33:28 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Deleted volume successfully. Sep 25 11:33:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-88cb05da-63ce-4684-bd7d-c593b3915143 tempest-ServerRescueNegativeTestJSON-1162216136 None] Lock "cinder-d37540cc-95b2-4957-88ea-65d654610767-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:37 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:33:38 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Flow 'volume_create_manager' (176293fa-180d-49be-bbc3-3b180636d85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5abdff-e802-41e0-9b21-87a4d906d1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5abdff-e802-41e0-9b21-87a4d906d1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2097009171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2035b736-304b-4684-9f78-a2b2a83f8224,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51eec7e4fbb8462e975afcabea44f67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:33:41Z,use_quota=True,user_id='f0f1ef483b2d4d8fb935bca56fab6b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e0445f-b850-464c-900e-0d18ceef0902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e0445f-b850-464c-900e-0d18ceef0902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0c2274-6a60-4e3d-a00c-fea16e6fa732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0c2274-6a60-4e3d-a00c-fea16e6fa732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2035b736-304b-4684-9f78-a2b2a83f8224', 'volume_name': 'volume-2035b736-304b-4684-9f78-a2b2a83f8224', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68220776-b38d-4221-ab11-469d396bada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68220776-b38d-4221-ab11-469d396bada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd383c-8fb6-472d-989b-201b103b269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:40 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Volume 2035b736-304b-4684-9f78-a2b2a83f8224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2035b736-304b-4684-9f78-a2b2a83f8224', 'volume_size': 1} Sep 25 11:33:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2097009171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2035b736-304b-4684-9f78-a2b2a83f8224,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51eec7e4fbb8462e975afcabea44f67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:33:41Z,use_quota=True,user_id='f0f1ef483b2d4d8fb935bca56fab6b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Creating volume 2035b736-304b-4684-9f78-a2b2a83f8224 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:33:41 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:41 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 1073741824 Sep 25 11:33:41 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:41 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 1073741824" returned: 0 in 0.615s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:41 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 Sep 25 11:33:41 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:41 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224" returned: 0 in 0.292s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd383c-8fb6-472d-989b-201b103b269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2035b736-304b-4684-9f78-a2b2a83f8224', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c213c9f9-369d-4f81-a329-f0307eb6bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Volume volume-2035b736-304b-4684-9f78-a2b2a83f8224 (2035b736-304b-4684-9f78-a2b2a83f8224): created successfully Sep 25 11:33:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c213c9f9-369d-4f81-a329-f0307eb6bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Flow 'volume_create_manager' (176293fa-180d-49be-bbc3-3b180636d85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:33:42 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a47ef6e2-eb19-4fa7-bcea-601d196df081 tempest-VolumesTestJSON-1988674993 None] Created volume successfully. Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Flow 'volume_create_manager' (b3f7141b-f9a9-427c-a25d-04fc7061edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528e9e59-e81b-4e6e-99f2-9007c0f6f4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528e9e59-e81b-4e6e-99f2-9007c0f6f4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1091189963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898d76cc-f095-4646-a8ac-90a7f7c50dc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51eec7e4fbb8462e975afcabea44f67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:33:44Z,use_quota=True,user_id='f0f1ef483b2d4d8fb935bca56fab6b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713e0905-69e3-431d-b7ca-9c255deec51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713e0905-69e3-431d-b7ca-9c255deec51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229a0e38-635b-45b6-af36-17651568e063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229a0e38-635b-45b6-af36-17651568e063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898d76cc-f095-4646-a8ac-90a7f7c50dc2', 'volume_name': 'volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185a4c86-6824-4246-b900-89272e0c7147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185a4c86-6824-4246-b900-89272e0c7147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34839a0-1e18-4340-af90-c1098fc2a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:43 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Volume 898d76cc-f095-4646-a8ac-90a7f7c50dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2', 'volume_size': 1} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1091189963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898d76cc-f095-4646-a8ac-90a7f7c50dc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51eec7e4fbb8462e975afcabea44f67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:33:44Z,use_quota=True,user_id='f0f1ef483b2d4d8fb935bca56fab6b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Creating volume 898d76cc-f095-4646-a8ac-90a7f7c50dc2 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:33:43 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:33:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:43 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 1073741824 Sep 25 11:33:43 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:44 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 1073741824" returned: 0 in 0.583s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:44 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 Sep 25 11:33:44 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:44 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2" returned: 0 in 0.324s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34839a0-1e18-4340-af90-c1098fc2a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7f6639-896e-4965-abc2-72413154624a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:44 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Volume volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 (898d76cc-f095-4646-a8ac-90a7f7c50dc2): created successfully Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7f6639-896e-4965-abc2-72413154624a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Flow 'volume_create_manager' (b3f7141b-f9a9-427c-a25d-04fc7061edbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:33:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-899e63f3-fadc-4e6a-bf40-83a6e1861060 tempest-VolumesTestJSON-1988674993 None] Created volume successfully. Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Flow 'volume_create_manager' (f7b3f820-e799-484e-a8c1-08c5e7ca9455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158eff94-2d96-41d4-993a-abc35de1b09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158eff94-2d96-41d4-993a-abc35de1b09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-259225754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2895f5b1-2f81-415e-a858-ab173c4b7ceb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51eec7e4fbb8462e975afcabea44f67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:33:46Z,use_quota=True,user_id='f0f1ef483b2d4d8fb935bca56fab6b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215de54-f2bc-4290-8174-04dd6cf582bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215de54-f2bc-4290-8174-04dd6cf582bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff40221a-e3e8-4b39-ba8c-188298a3bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff40221a-e3e8-4b39-ba8c-188298a3bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2895f5b1-2f81-415e-a858-ab173c4b7ceb', 'volume_name': 'volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2c6d1b-af3e-4c80-ba89-0372f58911c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2c6d1b-af3e-4c80-ba89-0372f58911c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a94a817-8051-4495-99f8-f77be7c4b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:46 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Volume 2895f5b1-2f81-415e-a858-ab173c4b7ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb', 'volume_size': 1} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-259225754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2895f5b1-2f81-415e-a858-ab173c4b7ceb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51eec7e4fbb8462e975afcabea44f67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:33:46Z,use_quota=True,user_id='f0f1ef483b2d4d8fb935bca56fab6b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Creating volume 2895f5b1-2f81-415e-a858-ab173c4b7ceb {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:33:46 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:33:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:46 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb 1073741824 Sep 25 11:33:46 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:47 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb 1073741824" returned: 0 in 0.645s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:47 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb Sep 25 11:33:47 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:47 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb" returned: 0 in 0.363s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a94a817-8051-4495-99f8-f77be7c4b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25176ec4-c65c-41c1-af1c-c38432d89e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:47 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Volume volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb (2895f5b1-2f81-415e-a858-ab173c4b7ceb): created successfully Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25176ec4-c65c-41c1-af1c-c38432d89e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Flow 'volume_create_manager' (f7b3f820-e799-484e-a8c1-08c5e7ca9455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:33:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b657c76d-969f-4797-814b-ae3ec36ea7dd tempest-VolumesTestJSON-1988674993 None] Created volume successfully. Sep 25 11:33:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Acquiring lock "cinder-2895f5b1-2f81-415e-a858-ab173c4b7ceb-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Lock "cinder-2895f5b1-2f81-415e-a858-ab173c4b7ceb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Acquiring lock "cinder-quobyte-2895f5b1-2f81-415e-a858-ab173c4b7ceb" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Lock "cinder-quobyte-2895f5b1-2f81-415e-a858-ab173c4b7ceb" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f7fb6c-d39b-4eff-a987-8b95b88e40e7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:33:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:50 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb Sep 25 11:33:50 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:50 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb" returned: 0 in 0.501s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:50 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb Sep 25 11:33:50 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:51 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2895f5b1-2f81-415e-a858-ab173c4b7ceb" returned: 0 in 0.493s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Lock "cinder-quobyte-2895f5b1-2f81-415e-a858-ab173c4b7ceb" released by "delete_volume" :: held 1.085s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Created reservations ['fa1e6be8-02cc-4dd2-a58f-cabff7768f9c', 'fd9b3631-818e-4c94-87d2-7cf0ec349a39', 'a5ea2414-f29d-4650-99e9-38327f4ef000', 'aec2356b-c170-4e14-bd2f-0e4e81c2b08a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:51 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:33:51 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:52 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.499s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:33:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Deleted volume successfully. Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28a1909a-7a0c-42cd-8d27-d09ef99641dc tempest-VolumesTestJSON-1988674993 None] Lock "cinder-2895f5b1-2f81-415e-a858-ab173c4b7ceb-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Acquiring lock "cinder-898d76cc-f095-4646-a8ac-90a7f7c50dc2-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Lock "cinder-898d76cc-f095-4646-a8ac-90a7f7c50dc2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Acquiring lock "cinder-quobyte-898d76cc-f095-4646-a8ac-90a7f7c50dc2" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Lock "cinder-quobyte-898d76cc-f095-4646-a8ac-90a7f7c50dc2" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[59769c53-324b-4492-a341-8cd919ab2c4c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:33:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:52 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 Sep 25 11:33:52 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:53 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2" returned: 0 in 0.932s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:53 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2 Sep 25 11:33:53 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:54 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-898d76cc-f095-4646-a8ac-90a7f7c50dc2" returned: 0 in 0.457s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Flow 'volume_create_manager' (15a09aea-a5d6-49cb-964a-a3f35c12dac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2b5167-fde9-4f83-8807-0b801ccb99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Lock "cinder-quobyte-898d76cc-f095-4646-a8ac-90a7f7c50dc2" released by "delete_volume" :: held 1.559s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2b5167-fde9-4f83-8807-0b801ccb99cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1313295303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7ec69c-d4b0-4e89-8071-0991b304b5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9830a93662324428b006bc6abfe84e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:33:54Z,use_quota=True,user_id='06928f4e0fd84c72afe92d50d421f298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d04b00-9171-4abb-9c97-57a78574d2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d04b00-9171-4abb-9c97-57a78574d2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397b9d87-c054-41ff-abd3-3a1808ce3a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397b9d87-c054-41ff-abd3-3a1808ce3a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7ec69c-d4b0-4e89-8071-0991b304b5d3', 'volume_name': 'volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53aa942b-2356-4693-a589-3134945b3d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53aa942b-2356-4693-a589-3134945b3d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f2133d-ad8d-4364-b495-65f12307d5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:54 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Volume 2c7ec69c-d4b0-4e89-8071-0991b304b5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3', 'volume_size': 1} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1313295303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7ec69c-d4b0-4e89-8071-0991b304b5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9830a93662324428b006bc6abfe84e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:33:54Z,use_quota=True,user_id='06928f4e0fd84c72afe92d50d421f298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Creating volume 2c7ec69c-d4b0-4e89-8071-0991b304b5d3 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:33:54 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:54 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 1073741824 Sep 25 11:33:54 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Created reservations ['26acfbb4-aafb-4856-af50-8f9ca6f5f58f', '092d1d6c-f8a9-4ded-be7c-8588f053e388', '65bc2f0e-de5a-4afb-b232-17ff1988e9e5', '1cc2aa83-66d6-4b9e-a0e2-ef24eecc3e90'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:54 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:33:54 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:55 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.505s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:33:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Deleted volume successfully. Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d7b33306-c4d9-4382-8dfa-0e6aeab88d75 tempest-VolumesTestJSON-1988674993 None] Lock "cinder-898d76cc-f095-4646-a8ac-90a7f7c50dc2-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Acquiring lock "cinder-2035b736-304b-4684-9f78-a2b2a83f8224-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Lock "cinder-2035b736-304b-4684-9f78-a2b2a83f8224-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Acquiring lock "cinder-quobyte-2035b736-304b-4684-9f78-a2b2a83f8224" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Lock "cinder-quobyte-2035b736-304b-4684-9f78-a2b2a83f8224" acquired by "delete_volume" :: waited 0.046s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:33:55 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 1073741824" returned: 0 in 1.147s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b317f3-448c-45cb-b8fb-d795f0c92641]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:55 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 Sep 25 11:33:55 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:55 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 Sep 25 11:33:55 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:56 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3" returned: 0 in 0.479s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f2133d-ad8d-4364-b495-65f12307d5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc8351a-198a-4d29-a39b-fd9e159604c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:33:56 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Volume volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 (2c7ec69c-d4b0-4e89-8071-0991b304b5d3): created successfully Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc8351a-198a-4d29-a39b-fd9e159604c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Flow 'volume_create_manager' (15a09aea-a5d6-49cb-964a-a3f35c12dac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:33:56 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224" returned: 0 in 0.686s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-be8d5bef-336a-4e61-8160-129f06eb9786 tempest-TaggedAttachmentsTest-70355944 None] Created volume successfully. Sep 25 11:33:56 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224 Sep 25 11:33:56 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:56 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2035b736-304b-4684-9f78-a2b2a83f8224" returned: 0 in 0.459s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Lock "cinder-quobyte-2035b736-304b-4684-9f78-a2b2a83f8224" released by "delete_volume" :: held 1.253s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Created reservations ['8bf3eaec-0cda-49b5-bf4c-37391c77b0c6', '414ba493-acd8-4330-a00f-232255ecea33', '0675d2d8-c403-4625-9740-805006a3db5e', '596b8aa5-a16b-4595-9f24-45277882dbbd'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:33:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:33:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:33:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:33:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:57 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:33:57 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:57 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.403s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:57 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:33:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Deleted volume successfully. Sep 25 11:33:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-475b15a2-a827-46ad-994f-478851a1be1e tempest-VolumesTestJSON-1988674993 None] Lock "cinder-2035b736-304b-4684-9f78-a2b2a83f8224-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:06 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=37,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=22,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Flow 'volume_create_manager' (9b11f340-539c-4a31-b55e-2f86d462ad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481c0c7f-73d8-4049-856e-b0ba9ad33f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481c0c7f-73d8-4049-856e-b0ba9ad33f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-861517922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3595a6-ed77-4568-b505-45f049f6a252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fd9b1812e54e38a17d22fa1097c02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:08Z,use_quota=True,user_id='2b322543fb1d4182864890c3676f3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8bf918-590b-4dcb-87f3-8dad69e658e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8bf918-590b-4dcb-87f3-8dad69e658e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b288e8-5f25-48f9-84ad-a789dcf58154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b288e8-5f25-48f9-84ad-a789dcf58154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3595a6-ed77-4568-b505-45f049f6a252', 'volume_name': 'volume-6b3595a6-ed77-4568-b505-45f049f6a252', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cb658e-a9bd-4226-aae3-bac7c785c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cb658e-a9bd-4226-aae3-bac7c785c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20be310-1488-4ffb-abe4-e12f2051218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:07 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Volume 6b3595a6-ed77-4568-b505-45f049f6a252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3595a6-ed77-4568-b505-45f049f6a252', 'volume_size': 1} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-861517922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3595a6-ed77-4568-b505-45f049f6a252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fd9b1812e54e38a17d22fa1097c02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:08Z,use_quota=True,user_id='2b322543fb1d4182864890c3676f3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Creating volume 6b3595a6-ed77-4568-b505-45f049f6a252 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:34:07 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:34:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:08 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 1073741824 Sep 25 11:34:08 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:08 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 1073741824" returned: 0 in 0.526s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:08 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 Sep 25 11:34:08 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:09 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252" returned: 0 in 0.510s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:34:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20be310-1488-4ffb-abe4-e12f2051218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3595a6-ed77-4568-b505-45f049f6a252', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb7cd55-d105-490c-a010-e16d1a4fdc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Volume volume-6b3595a6-ed77-4568-b505-45f049f6a252 (6b3595a6-ed77-4568-b505-45f049f6a252): created successfully Sep 25 11:34:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb7cd55-d105-490c-a010-e16d1a4fdc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Flow 'volume_create_manager' (9b11f340-539c-4a31-b55e-2f86d462ad98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:09 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8370e049-b7dd-476f-82b5-9df75bb102cc tempest-VolumesServicesTestJSON-257805543 None] Created volume successfully. Sep 25 11:34:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Acquiring lock "cinder-6b3595a6-ed77-4568-b505-45f049f6a252-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Lock "cinder-6b3595a6-ed77-4568-b505-45f049f6a252-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Acquiring lock "cinder-quobyte-6b3595a6-ed77-4568-b505-45f049f6a252" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Lock "cinder-quobyte-6b3595a6-ed77-4568-b505-45f049f6a252" acquired by "delete_volume" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:10 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d16af1-c2ce-4537-86cc-faa711d8b455]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:34:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:10 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 Sep 25 11:34:10 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:11 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252" returned: 0 in 0.738s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:11 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252 Sep 25 11:34:11 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:11 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6b3595a6-ed77-4568-b505-45f049f6a252" returned: 0 in 0.537s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Lock "cinder-quobyte-6b3595a6-ed77-4568-b505-45f049f6a252" released by "delete_volume" :: held 1.348s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Created reservations ['5d865c14-3c2f-4635-8a57-e06f46b41743', '04e2dd14-615d-43b4-9fab-82be4135fc5c', 'c1431ef3-e707-4334-959b-d1e07c0fa139', 'eeb98b7c-62e5-413f-90d3-73e9a9aa8d19'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:12 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:34:12 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:12 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.540s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:12 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:34:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Deleted volume successfully. Sep 25 11:34:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-314bdd1a-9fb6-433c-8ea2-9f873630cd2d tempest-VolumesServicesTestJSON-257805543 None] Lock "cinder-6b3595a6-ed77-4568-b505-45f049f6a252-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:22 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:INSERT=3 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:23 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:34:23 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:23 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.492s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 8 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:34:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Flow 'volume_create_manager' (1c5a1131-8c16-4604-bffc-39fe6dfb37a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09145e49-6d65-4443-89d0-4de8019e8a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09145e49-6d65-4443-89d0-4de8019e8a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1903005501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bda4ab-1623-4664-b334-e246f1919cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8127392c9f94478c94b24d3214b1bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:24Z,use_quota=True,user_id='312805a5b4814ada9a7783160ccfd070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d4c780-4982-4a30-bedb-6c690ed0f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d4c780-4982-4a30-bedb-6c690ed0f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1773a83e-43f7-462c-97fe-4f861baaf1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1773a83e-43f7-462c-97fe-4f861baaf1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bda4ab-1623-4664-b334-e246f1919cb1', 'volume_name': 'volume-f8bda4ab-1623-4664-b334-e246f1919cb1', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bc5d92-4e61-4245-a01d-36a0b9f4630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bc5d92-4e61-4245-a01d-36a0b9f4630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292514b8-61c0-44a3-86a8-b214c07831e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:24 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Volume f8bda4ab-1623-4664-b334-e246f1919cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bda4ab-1623-4664-b334-e246f1919cb1', 'volume_size': 1} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1903005501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bda4ab-1623-4664-b334-e246f1919cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8127392c9f94478c94b24d3214b1bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:24Z,use_quota=True,user_id='312805a5b4814ada9a7783160ccfd070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Creating volume f8bda4ab-1623-4664-b334-e246f1919cb1 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:34:24 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:34:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:24 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 1073741824 Sep 25 11:34:24 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 1073741824" returned: 0 in 0.817s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:25 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:25 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 Sep 25 11:34:25 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:26 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1" returned: 0 in 0.600s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:34:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292514b8-61c0-44a3-86a8-b214c07831e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bda4ab-1623-4664-b334-e246f1919cb1', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0a3e27-b39e-48f8-9da0-53fc791365f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:26 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Volume volume-f8bda4ab-1623-4664-b334-e246f1919cb1 (f8bda4ab-1623-4664-b334-e246f1919cb1): created successfully Sep 25 11:34:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0a3e27-b39e-48f8-9da0-53fc791365f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Flow 'volume_create_manager' (1c5a1131-8c16-4604-bffc-39fe6dfb37a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e957ccdf-f0a1-4d6f-b53a-b4f710e1bf79 tempest-ServersNegativeTestJSON-1236947309 None] Created volume successfully. Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Flow 'volume_create_manager' (62448328-9355-4c27-a4be-5802f69c13d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daa99e3-1bb7-41ea-be64-2709510ff950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daa99e3-1bb7-41ea-be64-2709510ff950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-535343456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5e8d73-b082-4073-b65d-d7958da5af17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8127392c9f94478c94b24d3214b1bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:29Z,use_quota=True,user_id='312805a5b4814ada9a7783160ccfd070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86f34d7-870f-4801-b3fa-3182d9bf39a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86f34d7-870f-4801-b3fa-3182d9bf39a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba4bfaa-7680-4e9c-a1ab-0a76e0945787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba4bfaa-7680-4e9c-a1ab-0a76e0945787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5e8d73-b082-4073-b65d-d7958da5af17', 'volume_name': 'volume-0f5e8d73-b082-4073-b65d-d7958da5af17', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb8fb95-071b-49ed-9d07-9f3ee4dcf00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb8fb95-071b-49ed-9d07-9f3ee4dcf00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacfc578-9d52-4e24-b197-1e3c1ce5bc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:29 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Volume 0f5e8d73-b082-4073-b65d-d7958da5af17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5e8d73-b082-4073-b65d-d7958da5af17', 'volume_size': 1} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-535343456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5e8d73-b082-4073-b65d-d7958da5af17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8127392c9f94478c94b24d3214b1bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:29Z,use_quota=True,user_id='312805a5b4814ada9a7783160ccfd070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Creating volume 0f5e8d73-b082-4073-b65d-d7958da5af17 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:34:29 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:34:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:29 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 1073741824 Sep 25 11:34:29 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:30 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 1073741824" returned: 0 in 1.050s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:30 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 Sep 25 11:34:30 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:31 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17" returned: 0 in 0.569s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:34:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacfc578-9d52-4e24-b197-1e3c1ce5bc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5e8d73-b082-4073-b65d-d7958da5af17', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6d6f6f-1f4b-467a-b4b8-6cbf96b6a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Volume volume-0f5e8d73-b082-4073-b65d-d7958da5af17 (0f5e8d73-b082-4073-b65d-d7958da5af17): created successfully Sep 25 11:34:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6d6f6f-1f4b-467a-b4b8-6cbf96b6a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Flow 'volume_create_manager' (62448328-9355-4c27-a4be-5802f69c13d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4f5da203-94d6-4e8a-a067-81133b0eca76 tempest-ServersNegativeTestJSON-1236947309 None] Created volume successfully. Sep 25 11:34:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "cinder-0f5e8d73-b082-4073-b65d-d7958da5af17-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Lock "cinder-0f5e8d73-b082-4073-b65d-d7958da5af17-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "cinder-quobyte-0f5e8d73-b082-4073-b65d-d7958da5af17" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Lock "cinder-quobyte-0f5e8d73-b082-4073-b65d-d7958da5af17" acquired by "delete_volume" :: waited 0.051s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939976b-b5e2-4d3d-ab3e-a7147e252ed1]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:34:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:33 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 Sep 25 11:34:33 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:33 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17" returned: 0 in 0.816s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:33 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17 Sep 25 11:34:33 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:34 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0f5e8d73-b082-4073-b65d-d7958da5af17" returned: 0 in 0.660s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Lock "cinder-quobyte-0f5e8d73-b082-4073-b65d-d7958da5af17" released by "delete_volume" :: held 1.568s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Created reservations ['b53bfbdf-4c89-45d3-a8a1-a5e8672cc8e8', '15c72e91-45ab-42f0-949c-109ee46671ac', 'e41a14f1-d676-4f9b-a35b-4172cc468809', 'cd32f8a6-1cfe-4f64-8899-7dbeb657ba4d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:34 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:34:34 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:34 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.326s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:34 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:34:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Deleted volume successfully. Sep 25 11:34:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0d73780-85fe-4736-b2a7-b5db01450f5f tempest-ServersNegativeTestJSON-1236947309 None] Lock "cinder-0f5e8d73-b082-4073-b65d-d7958da5af17-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "cinder-f8bda4ab-1623-4664-b334-e246f1919cb1-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Lock "cinder-f8bda4ab-1623-4664-b334-e246f1919cb1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "cinder-quobyte-f8bda4ab-1623-4664-b334-e246f1919cb1" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Lock "cinder-quobyte-f8bda4ab-1623-4664-b334-e246f1919cb1" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:35 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d186d39-7522-49d2-a429-5715f7b75d18]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:34:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:35 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 Sep 25 11:34:35 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:36 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1" returned: 0 in 0.622s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:36 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1 Sep 25 11:34:36 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:36 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f8bda4ab-1623-4664-b334-e246f1919cb1" returned: 0 in 0.409s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Lock "cinder-quobyte-f8bda4ab-1623-4664-b334-e246f1919cb1" released by "delete_volume" :: held 1.110s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Created reservations ['8839fd27-3ad0-4c6b-9c94-1049a631cb0b', '70137012-909c-44c7-a166-01c694e91d2d', '56292d77-d7a7-4c9a-aa40-7d50f7684f94', 'a9b30e12-d498-4168-9e17-c424fa256281'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:36 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:34:36 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:37 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.318s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:37 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:34:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Deleted volume successfully. Sep 25 11:34:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-beec3928-04e6-4188-b183-9b359655e606 tempest-ServersNegativeTestJSON-1236947309 None] Lock "cinder-f8bda4ab-1623-4664-b334-e246f1919cb1-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Flow 'volume_create_manager' (910bfdaa-464e-40f2-8215-295d828b6603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5878aad6-b7a2-4f19-a420-5ca7879d950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5878aad6-b7a2-4f19-a420-5ca7879d950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-234815541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f84d544-1cd7-4a38-8cfd-0a81a84a8466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b292213499c49f684c586f1ebbb89eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:40Z,use_quota=True,user_id='bc2acea30c864a66b9898222236017f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3ca9cf-4575-4a53-8064-61f44f1ff11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3ca9cf-4575-4a53-8064-61f44f1ff11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6365c0b4-75ff-4052-aa7a-4c94be5866c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6365c0b4-75ff-4052-aa7a-4c94be5866c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f84d544-1cd7-4a38-8cfd-0a81a84a8466', 'volume_name': 'volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6755303-4f4b-4d1f-a937-0872c81f6861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6755303-4f4b-4d1f-a937-0872c81f6861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e066ba-69d0-4c45-8966-a1681514cab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:39 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Volume 5f84d544-1cd7-4a38-8cfd-0a81a84a8466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466', 'volume_size': 1} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-234815541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f84d544-1cd7-4a38-8cfd-0a81a84a8466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b292213499c49f684c586f1ebbb89eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:40Z,use_quota=True,user_id='bc2acea30c864a66b9898222236017f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Creating volume 5f84d544-1cd7-4a38-8cfd-0a81a84a8466 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:34:40 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:34:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:40 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 1073741824 Sep 25 11:34:40 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:40 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 1073741824" returned: 0 in 0.811s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:40 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 Sep 25 11:34:40 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:41 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" returned: 0 in 0.362s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:34:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e066ba-69d0-4c45-8966-a1681514cab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038fcba7-56be-40ac-8bc2-aba58c97f798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:41 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Volume volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 (5f84d544-1cd7-4a38-8cfd-0a81a84a8466): created successfully Sep 25 11:34:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038fcba7-56be-40ac-8bc2-aba58c97f798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Flow 'volume_create_manager' (910bfdaa-464e-40f2-8215-295d828b6603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:41 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6d56a1e6-2a0e-4212-9a71-77249112a1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Created volume successfully. Sep 25 11:34:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Creating offline snapshot b9359788-08a6-4c9a-821d-6ba460fafecc of volume 5f84d544-1cd7-4a38-8cfd-0a81a84a8466 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:34:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[80031f93-e28a-4baa-9ba0-5c3155a3237e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:34:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:42 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 Sep 25 11:34:42 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:42 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" returned: 0 in 0.476s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:42 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc 1G Sep 25 11:34:42 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:43 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc 1G" returned: 0 in 0.433s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:43 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc Sep 25 11:34:43 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:43 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc" returned: 0 in 0.347s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:43 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc is being set with open permissions: ugo+rw Sep 25 11:34:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:43 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc Sep 25 11:34:43 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:43 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc" returned: 0 in 0.285s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:43 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.info Sep 25 11:34:43 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:44 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.info" returned: 0 in 0.317s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:44 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.info is being set with open permissions: ugo+rw Sep 25 11:34:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:44 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.info Sep 25 11:34:44 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:44 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.info" returned: 0 in 0.357s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a005cf31-39f2-438d-a809-f3e55071c883 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Create snapshot completed successfully Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "cinder-b9359788-08a6-4c9a-821d-6ba460fafecc-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-b9359788-08a6-4c9a-821d-6ba460fafecc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "cinder-quobyte-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-quobyte-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "cinder-quobyte-b9359788-08a6-4c9a-821d-6ba460fafecc" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-quobyte-b9359788-08a6-4c9a-821d-6ba460fafecc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Deleting offline snapshot b9359788-08a6-4c9a-821d-6ba460fafecc of volume 5f84d544-1cd7-4a38-8cfd-0a81a84a8466 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] snapshot_file for this snap is: volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a0d91a-2460-4c06-891f-029d1985a8fa]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:34:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:46 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc Sep 25 11:34:46 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:46 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc" returned: 0 in 0.475s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:34:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[451f2eb7-cb11-43e9-b54d-48cdc4b58ee4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:34:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:46 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 Sep 25 11:34:46 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:47 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" returned: 0 in 0.508s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:47 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc Sep 25 11:34:47 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:47 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc" returned: 0 in 0.428s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:47 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc Sep 25 11:34:47 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:47 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466.b9359788-08a6-4c9a-821d-6ba460fafecc" returned: 0 in 0.340s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-quobyte-b9359788-08a6-4c9a-821d-6ba460fafecc" released by "_delete_snapshot" :: held 1.911s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-quobyte-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" released by "delete_snapshot" :: held 1.946s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:47 devstack cinder-volume[87356]: WARNING cinder.quota [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:34:48 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Created reservations ['b50a817f-50ba-420f-9faa-8db52737ebb0', '24f14649-9977-4f6f-a8c9-42c760a348de', '96270859-2345-4884-9863-617a236c8e39', '38dcd0da-5972-41de-a35e-fd2f5587b075'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:34:48 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Delete snapshot completed successfully. Sep 25 11:34:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f670f87d-7385-4e5a-b693-2d77b33b3566 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-b9359788-08a6-4c9a-821d-6ba460fafecc-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "cinder-5f84d544-1cd7-4a38-8cfd-0a81a84a8466-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-5f84d544-1cd7-4a38-8cfd-0a81a84a8466-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "cinder-quobyte-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-quobyte-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:49 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b89ccf-1143-4d99-b673-ad4f24a6f589]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:34:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:49 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 Sep 25 11:34:49 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:49 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" returned: 0 in 0.392s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:49 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466 Sep 25 11:34:49 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:50 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" returned: 0 in 0.310s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-quobyte-5f84d544-1cd7-4a38-8cfd-0a81a84a8466" released by "delete_volume" :: held 0.787s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Created reservations ['f9bc6d97-c5aa-4bac-925f-6c498ef61ca5', '00c77ede-664f-4699-80e5-f69f13f4afe6', 'e0468f7d-0c89-48d6-90b8-58c6f9876ac3', '41898078-f23f-4e7e-9046-02da22e6d4e5'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:50 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:34:50 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:50 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.314s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:34:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Deleted volume successfully. Sep 25 11:34:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c1a8077-eb34-4022-98e8-f49b4b3453f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1189182062 None] Lock "cinder-5f84d544-1cd7-4a38-8cfd-0a81a84a8466-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Flow 'volume_create_manager' (ed46277f-8649-4e04-bcc9-817fa9600044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b8ee52-c796-4989-ba6a-27b117fc15af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b8ee52-c796-4989-ba6a-27b117fc15af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2013907496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0d079b-18b6-4ed3-a8ae-505cd181701e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cd4365c14cb4ec6b0c3ed4c1be7b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:53Z,use_quota=True,user_id='07a0077a9b224001b98ec2021b5341a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9a6c8c-70c7-4292-b8be-7f34ae004784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9a6c8c-70c7-4292-b8be-7f34ae004784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e57076-d007-45f4-99ac-7fa743980902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e57076-d007-45f4-99ac-7fa743980902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0d079b-18b6-4ed3-a8ae-505cd181701e', 'volume_name': 'volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591836a4-a48c-497b-a133-36a728cb3da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591836a4-a48c-497b-a133-36a728cb3da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d537c277-90d6-4907-84f9-fb70eb5038ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:53 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Volume 2e0d079b-18b6-4ed3-a8ae-505cd181701e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e', 'volume_size': 1} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2013907496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0d079b-18b6-4ed3-a8ae-505cd181701e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cd4365c14cb4ec6b0c3ed4c1be7b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:34:53Z,use_quota=True,user_id='07a0077a9b224001b98ec2021b5341a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Creating volume 2e0d079b-18b6-4ed3-a8ae-505cd181701e {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:34:53 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:34:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:53 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e 1073741824 Sep 25 11:34:53 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:54 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e 1073741824" returned: 0 in 0.583s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:54 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e Sep 25 11:34:54 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:54 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e" returned: 0 in 0.433s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d537c277-90d6-4907-84f9-fb70eb5038ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8464df7-491b-4e21-9839-9c59bf214b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:34:54 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Volume volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e (2e0d079b-18b6-4ed3-a8ae-505cd181701e): created successfully Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8464df7-491b-4e21-9839-9c59bf214b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:34:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Flow 'volume_create_manager' (ed46277f-8649-4e04-bcc9-817fa9600044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:34:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-5ec83d41-dad8-4596-a2af-5cf5b63daa74 req-de5491de-f9e6-4b0a-aab7-f86a71d97755 tempest-VolumesGetTestJSON-206099972 None] Created volume successfully. Sep 25 11:34:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Acquiring lock "cinder-2e0d079b-18b6-4ed3-a8ae-505cd181701e-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Lock "cinder-2e0d079b-18b6-4ed3-a8ae-505cd181701e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Acquiring lock "cinder-quobyte-2e0d079b-18b6-4ed3-a8ae-505cd181701e" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:34:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Lock "cinder-quobyte-2e0d079b-18b6-4ed3-a8ae-505cd181701e" acquired by "delete_volume" :: waited 0.071s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:34:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aabdf7-3f8b-4bca-8823-a0410bd5ab07]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:34:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:56 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e Sep 25 11:34:56 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:57 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e" returned: 0 in 0.611s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:57 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e Sep 25 11:34:57 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:57 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2e0d079b-18b6-4ed3-a8ae-505cd181701e" returned: 0 in 0.403s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Lock "cinder-quobyte-2e0d079b-18b6-4ed3-a8ae-505cd181701e" released by "delete_volume" :: held 1.159s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG cinder.quota [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Created reservations ['d13749be-f913-4d6a-b4a3-8ea1b712f8af', '76b98479-f887-4ecd-aead-3d09de78a8da', 'f9ec2548-4c79-4eaa-bdc2-577fa4b73744', 'fee6b209-2966-4980-9642-7a884671b3f7'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:57 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:34:57 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:58 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.323s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:58 devstack cinder-volume[87356]: DEBUG cinder.manager [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:34:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Deleted volume successfully. Sep 25 11:34:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-797645f1-92b8-4f3e-8240-77b6180307a3 req-2d35cab6-e379-40c7-adcc-91b107f6fa0d tempest-VolumesGetTestJSON-206099972 None] Lock "cinder-2e0d079b-18b6-4ed3-a8ae-505cd181701e-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:34:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-f212b8ba-d56d-4ff0-a7b5-ac4d7350176a req-38f93307-ac32-46a5-b995-e5bca437ea73 tempest-TaggedAttachmentsTest-70355944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:34:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-f212b8ba-d56d-4ff0-a7b5-ac4d7350176a req-38f93307-ac32-46a5-b995-e5bca437ea73 tempest-TaggedAttachmentsTest-70355944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:34:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-f212b8ba-d56d-4ff0-a7b5-ac4d7350176a req-38f93307-ac32-46a5-b995-e5bca437ea73 tempest-TaggedAttachmentsTest-70355944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:34:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-f212b8ba-d56d-4ff0-a7b5-ac4d7350176a req-38f93307-ac32-46a5-b995-e5bca437ea73 tempest-TaggedAttachmentsTest-70355944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d01fcdf-8de5-499e-852a-3614bb6ef73d', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:34:59 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-f212b8ba-d56d-4ff0-a7b5-ac4d7350176a req-38f93307-ac32-46a5-b995-e5bca437ea73 tempest-TaggedAttachmentsTest-70355944 None] attachment_update completed successfully. Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Flow 'volume_create_manager' (4c19be4d-c01d-4d79-b971-f4f7da0e936e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec66d54-c5b3-4d4e-a82f-b4fa2e2fe43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec66d54-c5b3-4d4e-a82f-b4fa2e2fe43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1146967372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af33e31-16dd-4cb8-b421-6b4da15ee11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5495d437042a9a19c4161cc049872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:00Z,use_quota=True,user_id='ef46e4bbf585459d9c9818a2a631ab04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3affd6a5-081a-4fce-8120-f41cc8bdde17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3affd6a5-081a-4fce-8120-f41cc8bdde17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e87f966-9b26-4626-b71c-5cc42b0df127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e87f966-9b26-4626-b71c-5cc42b0df127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af33e31-16dd-4cb8-b421-6b4da15ee11d', 'volume_name': 'volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb412564-3116-48cc-ab98-f808c28eb9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb412564-3116-48cc-ab98-f808c28eb9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023a0501-c571-4081-bdb7-a8a44c04f945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Volume 5af33e31-16dd-4cb8-b421-6b4da15ee11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d', 'volume_size': 1} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1146967372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af33e31-16dd-4cb8-b421-6b4da15ee11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5495d437042a9a19c4161cc049872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:00Z,use_quota=True,user_id='ef46e4bbf585459d9c9818a2a631ab04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Creating volume 5af33e31-16dd-4cb8-b421-6b4da15ee11d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:35:00 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:00 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d 1073741824 Sep 25 11:35:00 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:00 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d 1073741824" returned: 0 in 0.610s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:01 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d Sep 25 11:35:01 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:01 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d" returned: 0 in 0.468s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:35:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023a0501-c571-4081-bdb7-a8a44c04f945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c189a7-6e88-4a3d-8c20-6d16a5878e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Volume volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d (5af33e31-16dd-4cb8-b421-6b4da15ee11d): created successfully Sep 25 11:35:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c189a7-6e88-4a3d-8c20-6d16a5878e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Flow 'volume_create_manager' (4c19be4d-c01d-4d79-b971-f4f7da0e936e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:01 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f11e6187-50b4-4b55-91a1-dccd93d7297e tempest-AttachVolumeShelveTestJSON-1969023258 None] Created volume successfully. Sep 25 11:35:02 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-f836137d-1473-44e8-a719-617bc2f094ea req-69678610-ad94-4822-a0f9-548efe216f03 tempest-TaggedAttachmentsTest-70355944 None] Terminate volume connection completed successfully. Sep 25 11:35:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-f836137d-1473-44e8-a719-617bc2f094ea req-69678610-ad94-4822-a0f9-548efe216f03 tempest-TaggedAttachmentsTest-70355944 None] Deleting attachment 7d01fcdf-8de5-499e-852a-3614bb6ef73d. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:35:12 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=44,cinder:UPDATE=47,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:35:12 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=49,cinder:INSERT=12,cinder:UPDATE=64,cinder:DELETE=4 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:35:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9af81df8-c8e0-40c2-8588-2d0d0b6ab1df tempest-BackendsCapabilitiesAdminTestsJSON-443386154 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.434913635254, 'free_capacity_gb': 1775.434913635254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87356) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 11:35:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-886675c0-f6c3-4581-85be-cc6b48619a25 tempest-BackendsCapabilitiesAdminTestsJSON-443386154 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.434913635254, 'free_capacity_gb': 1775.434913635254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87356) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Acquiring lock "cinder-2c7ec69c-d4b0-4e89-8071-0991b304b5d3-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Lock "cinder-2c7ec69c-d4b0-4e89-8071-0991b304b5d3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Acquiring lock "cinder-quobyte-2c7ec69c-d4b0-4e89-8071-0991b304b5d3" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Lock "cinder-quobyte-2c7ec69c-d4b0-4e89-8071-0991b304b5d3" acquired by "delete_volume" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac6d68-d31d-4a13-93d3-22aea308d5ed]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:17 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 Sep 25 11:35:17 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-9f06a87b-e8f8-4e79-ab79-208e5f9ed81c req-e999a9db-0205-40b3-a05a-2cee8c47bae3 tempest-AttachVolumeShelveTestJSON-1969023258 None] No connector for attachment c4a81e7a-141d-4780-8196-3676b7ee7c1d; skipping storage backend terminate_connection call. {{(pid=87356) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-9f06a87b-e8f8-4e79-ab79-208e5f9ed81c req-e999a9db-0205-40b3-a05a-2cee8c47bae3 tempest-AttachVolumeShelveTestJSON-1969023258 None] Deleting attachment c4a81e7a-141d-4780-8196-3676b7ee7c1d. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:35:17 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3" returned: 0 in 0.553s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:17 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3 Sep 25 11:35:17 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:18 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c7ec69c-d4b0-4e89-8071-0991b304b5d3" returned: 0 in 0.413s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Lock "cinder-quobyte-2c7ec69c-d4b0-4e89-8071-0991b304b5d3" released by "delete_volume" :: held 1.051s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Created reservations ['ccb64ff5-bd99-4b48-98b6-362d3d189b3e', '7e7927c5-d89e-406e-9778-ed53d6f6b1cf', '9bfa6599-dc5e-48d8-aba4-7424be54ac77', 'afeae045-b53d-4a01-a5c3-267d9584eab4'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:18 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:35:18 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:18 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.348s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:35:18 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Deleted volume successfully. Sep 25 11:35:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ab39ced-04b0-4cbe-ad07-7bb75b1241b0 tempest-TaggedAttachmentsTest-70355944 None] Lock "cinder-2c7ec69c-d4b0-4e89-8071-0991b304b5d3-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:23 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:35:23 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:23 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.328s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 8 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:35:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:35:28 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:35:28 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Flow 'volume_create_manager' (d5e1f613-a65b-42e1-abbb-9c49dd7bf23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb4b6ec-199e-43e2-8957-b627a5dec082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb4b6ec-199e-43e2-8957-b627a5dec082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-737027611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a30c8944853489990f3e31541d7ed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:31Z,use_quota=True,user_id='a3896a6b13da49f4a3782e3d26a3ee05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61be7749-c38f-4504-b188-d0639894729d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61be7749-c38f-4504-b188-d0639894729d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dfd0b9-0529-4eec-bbb2-005027a50fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dfd0b9-0529-4eec-bbb2-005027a50fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8', 'volume_name': 'volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655c30bc-f880-4e9f-a4f3-21fd1e5cca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655c30bc-f880-4e9f-a4f3-21fd1e5cca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d109734c-8389-4da7-9554-521cc22f7ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Volume b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8', 'volume_size': 1} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-737027611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a30c8944853489990f3e31541d7ed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:31Z,use_quota=True,user_id='a3896a6b13da49f4a3782e3d26a3ee05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Creating volume b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:35:31 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:35:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:31 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 1073741824 Sep 25 11:35:31 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:32 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 1073741824" returned: 0 in 0.850s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:32 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 Sep 25 11:35:32 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:32 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" returned: 0 in 0.491s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d109734c-8389-4da7-9554-521cc22f7ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64207ff6-256c-43fc-908d-b5c0b396333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:32 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Volume volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 (b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8): created successfully Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64207ff6-256c-43fc-908d-b5c0b396333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Flow 'volume_create_manager' (d5e1f613-a65b-42e1-abbb-9c49dd7bf23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:32 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d73d4766-3ef6-440e-b16c-f43683069840 tempest-VolumesDeleteCascade-353335356 None] Created volume successfully. Sep 25 11:35:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Creating offline snapshot 7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 of volume b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:35:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ef3752-e19e-45c9-9123-bcf7e5d76ec4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:33 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 Sep 25 11:35:33 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:34 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9ec8cbe6-d193-48a9-9f82-d9116871ba4e tempest-GroupsTest-1797711680 None] Group tempest-Group1-2045182824: creating Sep 25 11:35:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" returned: 0 in 0.686s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:34 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 1G Sep 25 11:35:34 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9ec8cbe6-d193-48a9-9f82-d9116871ba4e tempest-GroupsTest-1797711680 None] Group tempest-Group1-2045182824: created successfully Sep 25 11:35:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9ec8cbe6-d193-48a9-9f82-d9116871ba4e tempest-GroupsTest-1797711680 None] Create group completed successfully. Sep 25 11:35:34 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 1G" returned: 0 in 0.545s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:34 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 Sep 25 11:35:34 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:35 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" returned: 0 in 0.422s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:35 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 is being set with open permissions: ugo+rw Sep 25 11:35:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:35 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 Sep 25 11:35:35 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:35 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5fb3d89f-dfec-46c4-b44a-3fd6e70e2e04 tempest-GroupsTest-1797711680 None] Group tempest-Group2-270873356: creating Sep 25 11:35:35 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5fb3d89f-dfec-46c4-b44a-3fd6e70e2e04 tempest-GroupsTest-1797711680 None] Group tempest-Group2-270873356: created successfully Sep 25 11:35:35 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5fb3d89f-dfec-46c4-b44a-3fd6e70e2e04 tempest-GroupsTest-1797711680 None] Create group completed successfully. Sep 25 11:35:35 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" returned: 0 in 0.497s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:35 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.info Sep 25 11:35:35 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:36 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.info" returned: 0 in 0.302s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:36 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.info is being set with open permissions: ugo+rw Sep 25 11:35:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:36 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.info Sep 25 11:35:36 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:36 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.info" returned: 0 in 0.272s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.924s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8fb6c418-a66f-4b72-86d1-c01f8e1981c7 tempest-VolumesDeleteCascade-353335356 None] Create snapshot completed successfully Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Creating offline snapshot 6da6a9a7-d5d2-47e1-90eb-5464f792e3af of volume b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d0d2c4-6452-4f86-af06-136dbcddaa17]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:37 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 Sep 25 11:35:37 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:35:37 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Flow 'volume_create_manager' (498a1f1f-5481-4d76-a2de-ec6c5a73d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76c9883-b9ce-4f44-827f-c59bcf62b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" returned: 0 in 0.570s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76c9883-b9ce-4f44-827f-c59bcf62b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448154574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b1d2952-024d-420f-9c6e-d6fabfc9e836,host='devstack@QuobyteHD#QuobyteHD',id=209bd219-bcc7-40fc-bde6-c370c205e75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a1697ff18f4f1fb6e150d45d8b44b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:38Z,use_quota=True,user_id='9b382797f9c44c99951eb010cd14dc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ea029a5-fced-4546-ba53-e5b348c77284),volume_type_id=8ea029a5-fced-4546-ba53-e5b348c77284)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75000414-8b6b-4b94-8aac-08bdbc51d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75000414-8b6b-4b94-8aac-08bdbc51d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a45346c-e98c-4311-9249-fe979e744385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:37 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af 1G Sep 25 11:35:37 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a45346c-e98c-4311-9249-fe979e744385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209bd219-bcc7-40fc-bde6-c370c205e75f', 'volume_name': 'volume-209bd219-bcc7-40fc-bde6-c370c205e75f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee7c9ca-ea21-4271-ac0a-0843cc739c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee7c9ca-ea21-4271-ac0a-0843cc739c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edf69f6-212b-4e8b-9ebc-7dcc9af70155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:37 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Volume 209bd219-bcc7-40fc-bde6-c370c205e75f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209bd219-bcc7-40fc-bde6-c370c205e75f', 'volume_size': 1} Sep 25 11:35:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:38 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af 1G" returned: 0 in 0.547s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:38 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af Sep 25 11:35:38 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:38 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af" returned: 0 in 0.314s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:38 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af is being set with open permissions: ugo+rw Sep 25 11:35:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:38 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af Sep 25 11:35:38 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:38 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af" returned: 0 in 0.371s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b1d2952-024d-420f-9c6e-d6fabfc9e836,created_at=2026-09-25T09:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448154574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b1d2952-024d-420f-9c6e-d6fabfc9e836,host='devstack@QuobyteHD#QuobyteHD',id=209bd219-bcc7-40fc-bde6-c370c205e75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a1697ff18f4f1fb6e150d45d8b44b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:38Z,use_quota=True,user_id='9b382797f9c44c99951eb010cd14dc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ea029a5-fced-4546-ba53-e5b348c77284),volume_type_id=8ea029a5-fced-4546-ba53-e5b348c77284)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Creating volume 209bd219-bcc7-40fc-bde6-c370c205e75f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:35:39 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:39 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f 1073741824 Sep 25 11:35:39 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:39 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-cb9934df-9967-4883-bcab-7c5c60a6ac55 tempest-VolumesDeleteCascade-353335356 None] Create snapshot completed successfully Sep 25 11:35:39 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f 1073741824" returned: 0 in 0.552s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:39 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f Sep 25 11:35:39 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:39 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f" returned: 0 in 0.284s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edf69f6-212b-4e8b-9ebc-7dcc9af70155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209bd219-bcc7-40fc-bde6-c370c205e75f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb17c1b-9084-463b-955f-7e132f9ee6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:39 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Volume volume-209bd219-bcc7-40fc-bde6-c370c205e75f (209bd219-bcc7-40fc-bde6-c370c205e75f): created successfully Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb17c1b-9084-463b-955f-7e132f9ee6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Flow 'volume_create_manager' (498a1f1f-5481-4d76-a2de-ec6c5a73d049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:40 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-65fbab35-09ff-41bd-b40b-ffd75c36aa12 tempest-GroupsTest-1797711680 None] Created volume successfully. Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Performing cascade delete. {{(pid=87356) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-6da6a9a7-d5d2-47e1-90eb-5464f792e3af-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-6da6a9a7-d5d2-47e1-90eb-5464f792e3af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-6da6a9a7-d5d2-47e1-90eb-5464f792e3af" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-6da6a9a7-d5d2-47e1-90eb-5464f792e3af" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Deleting offline snapshot 6da6a9a7-d5d2-47e1-90eb-5464f792e3af of volume b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] snapshot_file for this snap is: volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f28cb97-4a41-4543-8dca-674c753a4098]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:40 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af Sep 25 11:35:40 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:40 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af" returned: 0 in 0.390s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29ba126-28f0-4419-b23e-536ff6923bf7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:41 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 Sep 25 11:35:41 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:41 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" returned: 0 in 0.621s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:35:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:41 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af Sep 25 11:35:41 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:42 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af" returned: 0 in 0.500s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:42 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af Sep 25 11:35:42 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Acquiring lock "cinder-quobyte-209bd219-bcc7-40fc-bde6-c370c205e75f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Lock "cinder-quobyte-209bd219-bcc7-40fc-bde6-c370c205e75f" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ab68f2-86a8-4700-a3a2-1cb5a8b2ce16]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:42 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f Sep 25 11:35:42 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:42 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.6da6a9a7-d5d2-47e1-90eb-5464f792e3af" returned: 0 in 0.388s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-6da6a9a7-d5d2-47e1-90eb-5464f792e3af" released by "_delete_snapshot" :: held 2.027s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" released by "delete_snapshot" :: held 2.059s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Created reservations ['a3504730-5751-49e5-b3fb-b380386da189', '6f018a46-076e-4206-bf49-76417b002c27', '362ee054-a208-44bb-a42e-99e3f8a3885b', 'e4c5b56e-f179-4c59-bcd8-fe6da3f8528b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:35:42 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f" returned: 0 in 0.543s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:42 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Delete snapshot completed successfully. Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-6da6a9a7-d5d2-47e1-90eb-5464f792e3af-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:42 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f Sep 25 11:35:42 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Deleting offline snapshot 7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 of volume b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] snapshot_file for this snap is: volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ca290-7b3d-4406-91af-17fee3af5884]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:43 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 Sep 25 11:35:43 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:43 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-209bd219-bcc7-40fc-bde6-c370c205e75f" returned: 0 in 0.551s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Lock "cinder-quobyte-209bd219-bcc7-40fc-bde6-c370c205e75f" released by "delete_volume" :: held 1.165s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Created reservations ['06b58816-11c6-4a4f-93aa-69a8e5e8cf47'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:35:43 devstack cinder-volume[87356]: WARNING cinder.quota [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2092899894 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2092899894, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:35:43 devstack cinder-volume[87356]: WARNING cinder.quota [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2092899894 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2092899894, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Created reservations ['75450917-7bac-4028-a7cf-12d459a4f98d', '5ac5439f-8e69-4f55-8a98-507adfeeddb3', '0f5a7731-ea43-4dfc-a2fd-e745432fc8df', '62ee232b-b8cc-488f-9c9e-98ebff903a9c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:35:43 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" returned: 0 in 0.831s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[457cbc61-1f10-42c4-a280-7c50625d6b7b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:43 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:35:43 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:44 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 Sep 25 11:35:44 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:44 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.416s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:44 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:35:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-df651321-dfc6-4d16-8714-f95b138cd962 tempest-GroupsTest-1797711680 None] Delete group completed successfully. Sep 25 11:35:44 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" returned: 0 in 0.620s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:44 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 Sep 25 11:35:44 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:44 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" returned: 0 in 0.569s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:45 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9 Sep 25 11:35:45 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Created reservations ['d92b5d5d-10fa-4336-a5e1-24625c2dd66b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:45 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:35:45 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:45 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8.7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" returned: 0 in 0.521s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9" released by "_delete_snapshot" :: held 2.746s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" released by "delete_snapshot" :: held 2.777s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:45 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.410s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:35:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a0d88e6d-3b86-4769-9b56-09aeb179c270 tempest-GroupsTest-1797711680 None] Delete group completed successfully. Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Created reservations ['5d5b6c20-544e-40b5-90d7-82bd1678036e', 'cfc36a55-79e8-4a1e-a8cc-e7df4f2475a0', 'cbd987b3-c4f6-4e2f-8b19-1b04d9560c9e', '69b12676-b5ef-4672-945d-3993668c12b5'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:35:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Delete snapshot completed successfully. Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-7d1cfadd-89d5-4ebc-97f0-270afdd4bfe9-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Snapshots deleted, issuing volume delete {{(pid=87356) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2937587-e880-40cd-b7b4-852c31b04498]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:46 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 Sep 25 11:35:46 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:46 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" returned: 0 in 0.583s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:46 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8 Sep 25 11:35:46 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:46 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" returned: 0 in 0.299s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8" released by "delete_volume" :: held 1.004s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:46 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Created reservations ['c9cd0750-154f-4eb1-aada-bbe93fe3e90d', '2ee44517-c1fc-4910-a419-896a23c52ae4', 'f244abb6-8076-4286-bfbf-c1000569cbec', 'c161a5f3-e3c5-44f6-a9c6-0bf36bf454e2'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:35:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f2d2c01c-a3c6-4612-ac96-2c5ffeeb413c tempest-GroupsTest-1797711680 None] Group tempest-GroupsTest-Group-1426860637: creating Sep 25 11:35:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f2d2c01c-a3c6-4612-ac96-2c5ffeeb413c tempest-GroupsTest-1797711680 None] Group tempest-GroupsTest-Group-1426860637: created successfully Sep 25 11:35:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f2d2c01c-a3c6-4612-ac96-2c5ffeeb413c tempest-GroupsTest-1797711680 None] Create group completed successfully. Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:47 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:35:47 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:47 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.298s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:35:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Deleted volume successfully. Sep 25 11:35:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85160744-38c3-4df5-b158-12cf9ba5aaaa tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-b2b24a8c-ee4e-4ee6-ac37-9ebb648a3ce8-delete_volume" released by "delete_volume" :: held 7.122s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Flow 'volume_create_manager' (c9e61550-1a0b-48cc-b185-2d6c8869d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc6db6b-7403-4476-8452-8189564b9a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc6db6b-7403-4476-8452-8189564b9a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-151311962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ab6440-d004-4b79-a338-bf7b620da00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a30c8944853489990f3e31541d7ed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:48Z,use_quota=True,user_id='a3896a6b13da49f4a3782e3d26a3ee05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780f29b9-e055-466c-91d0-04e5fb0a20c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780f29b9-e055-466c-91d0-04e5fb0a20c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a380267-ee29-4402-8eec-e1c4c59a8dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a380267-ee29-4402-8eec-e1c4c59a8dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ab6440-d004-4b79-a338-bf7b620da00f', 'volume_name': 'volume-01ab6440-d004-4b79-a338-bf7b620da00f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcc8900-a772-4ad1-9502-5e88b709c78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcc8900-a772-4ad1-9502-5e88b709c78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8312c029-149f-4770-af99-6a3c382e8efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Volume 01ab6440-d004-4b79-a338-bf7b620da00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ab6440-d004-4b79-a338-bf7b620da00f', 'volume_size': 1} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-151311962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ab6440-d004-4b79-a338-bf7b620da00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a30c8944853489990f3e31541d7ed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:48Z,use_quota=True,user_id='a3896a6b13da49f4a3782e3d26a3ee05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Creating volume 01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:35:48 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:48 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f 1073741824 Sep 25 11:35:48 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Flow 'volume_create_manager' (5f446f3f-2929-49a9-b5fd-59a5057c8d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93434541-8982-4129-969f-f93dd0828d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93434541-8982-4129-969f-f93dd0828d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004819011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5557aac-0e54-4bec-b7e1-3534bf1471a5,host='devstack@QuobyteHD#QuobyteHD',id=8866f7c1-a6e6-452d-8a82-e28fe9d77bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a1697ff18f4f1fb6e150d45d8b44b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:49Z,use_quota=True,user_id='9b382797f9c44c99951eb010cd14dc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ea3aa08-91a0-4268-ad3a-38ba97ccd61e),volume_type_id=3ea3aa08-91a0-4268-ad3a-38ba97ccd61e)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d88a622-d276-41ff-a02a-1973cbc2a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d88a622-d276-41ff-a02a-1973cbc2a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a2e0ea-f9a8-44c3-935c-9d0799e6a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a2e0ea-f9a8-44c3-935c-9d0799e6a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8866f7c1-a6e6-452d-8a82-e28fe9d77bc6', 'volume_name': 'volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:48 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5a19ea-6e38-4117-be7f-2e3b5a3cc9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5a19ea-6e38-4117-be7f-2e3b5a3cc9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8b666c-f6cf-4352-8152-3ec0a2154810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:48 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Volume 8866f7c1-a6e6-452d-8a82-e28fe9d77bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6', 'volume_size': 1} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f 1073741824" returned: 0 in 0.608s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:48 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f Sep 25 11:35:48 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:49 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f" returned: 0 in 0.293s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5557aac-0e54-4bec-b7e1-3534bf1471a5,created_at=2026-09-25T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004819011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5557aac-0e54-4bec-b7e1-3534bf1471a5,host='devstack@QuobyteHD#QuobyteHD',id=8866f7c1-a6e6-452d-8a82-e28fe9d77bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a1697ff18f4f1fb6e150d45d8b44b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:49Z,use_quota=True,user_id='9b382797f9c44c99951eb010cd14dc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ea3aa08-91a0-4268-ad3a-38ba97ccd61e),volume_type_id=3ea3aa08-91a0-4268-ad3a-38ba97ccd61e)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Creating volume 8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:35:49 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8312c029-149f-4770-af99-6a3c382e8efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ab6440-d004-4b79-a338-bf7b620da00f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93eca659-cf2f-43e3-8111-2b99af4d0fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:49 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 1073741824 Sep 25 11:35:49 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Volume volume-01ab6440-d004-4b79-a338-bf7b620da00f (01ab6440-d004-4b79-a338-bf7b620da00f): created successfully Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93eca659-cf2f-43e3-8111-2b99af4d0fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Flow 'volume_create_manager' (c9e61550-1a0b-48cc-b185-2d6c8869d576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:49 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a71b6224-d313-47e8-90ff-da0580a28d2c tempest-VolumesDeleteCascade-353335356 None] Created volume successfully. Sep 25 11:35:49 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 1073741824" returned: 0 in 0.485s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:49 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 Sep 25 11:35:49 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:49 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6" returned: 0 in 0.263s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8b666c-f6cf-4352-8152-3ec0a2154810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6736701-94d1-4ddc-bde8-2bd45fa23493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Volume volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 (8866f7c1-a6e6-452d-8a82-e28fe9d77bc6): created successfully Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6736701-94d1-4ddc-bde8-2bd45fa23493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Flow 'volume_create_manager' (5f446f3f-2929-49a9-b5fd-59a5057c8d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:49 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-71e2f6a0-af0a-4137-b7d5-7adaa0c43c0b tempest-GroupsTest-1797711680 None] Created volume successfully. Sep 25 11:35:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Creating offline snapshot b268298b-a9de-4e1c-a436-29ce5a0dd774 of volume 01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:35:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7fb39d-1305-4b81-bbd7-e2835c1718c0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:50 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f Sep 25 11:35:50 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:50 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f" returned: 0 in 0.359s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:50 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 1G Sep 25 11:35:50 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:51 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 1G" returned: 0 in 0.536s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ab6440-d004-4b79-a338-bf7b620da00f -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:51 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ab6440-d004-4b79-a338-bf7b620da00f -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 Sep 25 11:35:51 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:51 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ab6440-d004-4b79-a338-bf7b620da00f -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774" returned: 0 in 0.474s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:51 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 is being set with open permissions: ugo+rw Sep 25 11:35:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:51 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 Sep 25 11:35:51 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:51 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:35:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Flow 'volume_create_manager' (6d272eef-3682-4f13-bf18-27e2dee92a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0808ef-83f7-49bd-b972-55455b63830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0808ef-83f7-49bd-b972-55455b63830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1305543016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5557aac-0e54-4bec-b7e1-3534bf1471a5,host='devstack@QuobyteHD#QuobyteHD',id=367037ab-41e3-46d1-80d9-dd520915afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a1697ff18f4f1fb6e150d45d8b44b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:52Z,use_quota=True,user_id='9b382797f9c44c99951eb010cd14dc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ea3aa08-91a0-4268-ad3a-38ba97ccd61e),volume_type_id=3ea3aa08-91a0-4268-ad3a-38ba97ccd61e)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f61990-16ce-43e6-8ef1-2ae7fb0c35e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f61990-16ce-43e6-8ef1-2ae7fb0c35e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a369e6-e75e-44df-8834-16245a77412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a369e6-e75e-44df-8834-16245a77412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '367037ab-41e3-46d1-80d9-dd520915afc0', 'volume_name': 'volume-367037ab-41e3-46d1-80d9-dd520915afc0', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b644c7-9a25-4ddf-ae56-523264178012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b644c7-9a25-4ddf-ae56-523264178012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b0787a-4df1-4814-ba5e-602d9c0a2cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:52 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Volume 367037ab-41e3-46d1-80d9-dd520915afc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-367037ab-41e3-46d1-80d9-dd520915afc0', 'volume_size': 1} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:52 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774" returned: 0 in 0.358s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:52 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.info Sep 25 11:35:52 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:52 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.info" returned: 0 in 0.283s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:52 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.info is being set with open permissions: ugo+rw Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:52 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.info Sep 25 11:35:52 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:52 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.info" returned: 0 in 0.277s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5557aac-0e54-4bec-b7e1-3534bf1471a5,created_at=2026-09-25T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1305543016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5557aac-0e54-4bec-b7e1-3534bf1471a5,host='devstack@QuobyteHD#QuobyteHD',id=367037ab-41e3-46d1-80d9-dd520915afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a1697ff18f4f1fb6e150d45d8b44b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:52Z,use_quota=True,user_id='9b382797f9c44c99951eb010cd14dc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ea3aa08-91a0-4268-ad3a-38ba97ccd61e),volume_type_id=3ea3aa08-91a0-4268-ad3a-38ba97ccd61e)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Creating volume 367037ab-41e3-46d1-80d9-dd520915afc0 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:35:52 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:35:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:52 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 1073741824 Sep 25 11:35:52 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-936d401e-741d-48fd-8dbc-f7751c83241d tempest-VolumesDeleteCascade-353335356 None] Create snapshot completed successfully Sep 25 11:35:53 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 1073741824" returned: 0 in 0.577s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:53 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 Sep 25 11:35:53 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:53 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0" returned: 0 in 0.310s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b0787a-4df1-4814-ba5e-602d9c0a2cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367037ab-41e3-46d1-80d9-dd520915afc0', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1da08c-7397-43aa-8f44-b53f15e6a622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:53 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Volume volume-367037ab-41e3-46d1-80d9-dd520915afc0 (367037ab-41e3-46d1-80d9-dd520915afc0): created successfully Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1da08c-7397-43aa-8f44-b53f15e6a622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Flow 'volume_create_manager' (6d272eef-3682-4f13-bf18-27e2dee92a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-73828d20-3820-4844-9f0f-80187586cd31 tempest-GroupsTest-1797711680 None] Created volume successfully. Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Flow 'volume_create_manager' (3054217d-d1cc-47ae-8fc4-d4ad06230e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77985217-c734-442d-94b6-e1e78038b19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77985217-c734-442d-94b6-e1e78038b19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-98205057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb53bad-0d58-42fc-bf30-fdb6006fd6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a30c8944853489990f3e31541d7ed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b268298b-a9de-4e1c-a436-29ce5a0dd774,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:35:54Z,use_quota=True,user_id='a3896a6b13da49f4a3782e3d26a3ee05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5caa1447-7e92-46f3-b208-8315e32169a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5caa1447-7e92-46f3-b208-8315e32169a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d455af0e-eb52-4ecc-bd18-167d3ade1c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d455af0e-eb52-4ecc-bd18-167d3ade1c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abb53bad-0d58-42fc-bf30-fdb6006fd6fe', 'volume_name': 'volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe', 'volume_size': 1, 'snapshot_id': 'b268298b-a9de-4e1c-a436-29ce5a0dd774'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e441eb-9dd9-4ccc-ba29-92f74bf20984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e441eb-9dd9-4ccc-ba29-92f74bf20984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c819705b-b2b7-4b1b-a2a1-a83b055d8a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:35:54 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Volume abb53bad-0d58-42fc-bf30-fdb6006fd6fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe', 'volume_size': 1, 'snapshot_id': 'b268298b-a9de-4e1c-a436-29ce5a0dd774'} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-b268298b-a9de-4e1c-a436-29ce5a0dd774-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b268298b-a9de-4e1c-a436-29ce5a0dd774-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Creating volume abb53bad-0d58-42fc-bf30-fdb6006fd6fe from snapshot b268298b-a9de-4e1c-a436-29ce5a0dd774 {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] snapshot: b268298b-a9de-4e1c-a436-29ce5a0dd774, volume: abb53bad-0d58-42fc-bf30-fdb6006fd6fe, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aba647f-b010-496e-9eef-6bf5ec009c9e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-19df3538-f72c-4464-8f43-b3759093b193 tempest-GroupsTest-1797711680 None] Update group completed successfully. Sep 25 11:35:54 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 Sep 25 11:35:54 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:55 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774" returned: 0 in 0.381s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ab6440-d004-4b79-a338-bf7b620da00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1532cb86-92e7-444d-b5bf-6bbc36be0cc1]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:55 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f Sep 25 11:35:55 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:55 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f" returned: 0 in 0.430s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:35:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:55 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe Sep 25 11:35:55 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-105fb1a5-16d5-43e0-aef8-553198bb9d9c tempest-GroupsTest-1797711680 None] Update group completed successfully. Sep 25 11:35:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Acquiring lock "cinder-quobyte-367037ab-41e3-46d1-80d9-dd520915afc0" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:35:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Lock "cinder-quobyte-367037ab-41e3-46d1-80d9-dd520915afc0" acquired by "delete_volume" :: waited 0.045s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:35:59 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c6376f-3ebf-4f7a-8683-29f1f15aaeee]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:35:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:59 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 Sep 25 11:35:59 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:00 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0" returned: 0 in 0.973s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:00 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0 Sep 25 11:36:00 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:01 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-367037ab-41e3-46d1-80d9-dd520915afc0" returned: 0 in 0.839s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Lock "cinder-quobyte-367037ab-41e3-46d1-80d9-dd520915afc0" released by "delete_volume" :: held 1.941s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Acquiring lock "cinder-quobyte-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Lock "cinder-quobyte-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:01 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[958ac512-84ab-46f7-8a28-74edb7802fed]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:01 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 Sep 25 11:36:01 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:02 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6" returned: 0 in 0.992s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:02 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6 Sep 25 11:36:02 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:03 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6" returned: 0 in 0.619s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Lock "cinder-quobyte-8866f7c1-a6e6-452d-8a82-e28fe9d77bc6" released by "delete_volume" :: held 1.736s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:03 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Created reservations ['52e90716-dcc3-423b-a3a0-e76d3910a6d6'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:03 devstack cinder-volume[87356]: WARNING cinder.quota [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1152727653 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1152727653, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:36:03 devstack cinder-volume[87356]: WARNING cinder.quota [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1152727653 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1152727653, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:36:03 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Created reservations ['d95f5ef8-e45d-42d4-9bdd-b035d461fcd9', 'f38c9e7a-4f1b-41a8-89be-9ad5139e5d60', '3820c017-3e9b-4cdd-8e4f-de6dda1e3d47', 'bfbb1fe7-8516-4fbe-85a9-1bf7d2441d6d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:03 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Created reservations ['f228c75a-e91e-438a-b38e-d32d94b87bc6', '90a87254-61ca-43e9-ba35-8a7ca8b336c2', '2120bf3c-c1bb-43ad-a245-39eafbcd5252', '9f8c361a-32a6-4d54-bf7b-eae504897dfb'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:04 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:36:04 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:05 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.958s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:05 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-48e02840-9d35-4688-9119-7eb6407231f0 tempest-GroupsTest-1797711680 None] Delete group completed successfully. Sep 25 11:36:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Acquiring lock "cinder-5af33e31-16dd-4cb8-b421-6b4da15ee11d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:05 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" returned: 0 in 10.458s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:05 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f, size 1024.00 MB, duration 10.46 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:36:05 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Converted 1024.00 MB image at 97.91 MB/s Sep 25 11:36:05 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe is being set with open permissions: ugo+rw Sep 25 11:36:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "cinder-5af33e31-16dd-4cb8-b421-6b4da15ee11d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:05 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe Sep 25 11:36:05 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Acquiring lock "cinder-quobyte-5af33e31-16dd-4cb8-b421-6b4da15ee11d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "cinder-quobyte-5af33e31-16dd-4cb8-b421-6b4da15ee11d" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ceb314-2808-4250-9781-634aab39c5be]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:06 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d Sep 25 11:36:06 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:06 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" returned: 0 in 0.384s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" released by "_copy_volume_from_snapshot" :: held 11.813s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b268298b-a9de-4e1c-a436-29ce5a0dd774-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" released by "_create_volume_from_snapshot" :: held 11.896s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.920s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c819705b-b2b7-4b1b-a2a1-a83b055d8a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe', 'volume_size': 1, 'snapshot_id': 'b268298b-a9de-4e1c-a436-29ce5a0dd774'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51289c-e0b7-4e74-ae91-de34cb674375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:06 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Volume volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe (abb53bad-0d58-42fc-bf30-fdb6006fd6fe): created successfully Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51289c-e0b7-4e74-ae91-de34cb674375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Flow 'volume_create_manager' (3054217d-d1cc-47ae-8fc4-d4ad06230e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:06 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-aa9e9e75-e385-44db-b904-ae8434583d2f tempest-VolumesDeleteCascade-353335356 None] Created volume successfully. Sep 25 11:36:06 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d" returned: 0 in 0.501s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:06 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d Sep 25 11:36:06 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:07 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5af33e31-16dd-4cb8-b421-6b4da15ee11d" returned: 0 in 0.443s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "cinder-quobyte-5af33e31-16dd-4cb8-b421-6b4da15ee11d" released by "delete_volume" :: held 1.032s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-01ab6440-d004-4b79-a338-bf7b620da00f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Created reservations ['20a4c560-efdf-4b5c-a6b1-43d2716b9900', '3dd666d9-7497-4ab9-8ad0-59d06d53f6ff', '2b389403-6217-4564-9072-5fe6141df048', '72d3ac52-7724-4435-8631-92394370c336'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-01ab6440-d004-4b79-a338-bf7b620da00f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Performing cascade delete. {{(pid=87356) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-b268298b-a9de-4e1c-a436-29ce5a0dd774-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-b268298b-a9de-4e1c-a436-29ce5a0dd774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-01ab6440-d004-4b79-a338-bf7b620da00f" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:07 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:36:07 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-01ab6440-d004-4b79-a338-bf7b620da00f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-b268298b-a9de-4e1c-a436-29ce5a0dd774" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b268298b-a9de-4e1c-a436-29ce5a0dd774" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Deleting offline snapshot b268298b-a9de-4e1c-a436-29ce5a0dd774 of volume 01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] snapshot_file for this snap is: volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dc8767-1104-4d4f-b448-204bb1d9541d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:08 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 Sep 25 11:36:08 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:08 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.718s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:08 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:08 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Deleted volume successfully. Sep 25 11:36:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1e0bf962-963c-4a7b-a23a-f8d6d48bf314 tempest-AttachVolumeShelveTestJSON-1969023258 None] Lock "cinder-5af33e31-16dd-4cb8-b421-6b4da15ee11d-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:08 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774" returned: 0 in 0.876s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ab6440-d004-4b79-a338-bf7b620da00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:36:08 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d2e51-23e7-421a-987c-3cf931ca6be9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:08 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f Sep 25 11:36:08 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:09 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f" returned: 0 in 0.839s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:09 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 Sep 25 11:36:09 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:10 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774" returned: 0 in 0.724s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:10 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774 Sep 25 11:36:10 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:10 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f.b268298b-a9de-4e1c-a436-29ce5a0dd774" returned: 0 in 0.715s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-b268298b-a9de-4e1c-a436-29ce5a0dd774" released by "_delete_snapshot" :: held 3.380s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-01ab6440-d004-4b79-a338-bf7b620da00f" released by "delete_snapshot" :: held 3.434s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Created reservations ['080ce260-dcea-489d-b953-0f115cf64621', 'e2d94c1e-d77c-45cd-9ef6-39c1714ff491', '6ee65d04-8f28-4fbe-b459-3a49db1bbfff', '35da107e-4353-48d2-96dc-92b07f2d2310'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Delete snapshot completed successfully. Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-b268298b-a9de-4e1c-a436-29ce5a0dd774-delete_snapshot" released by "delete_snapshot" :: held 3.676s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Snapshots deleted, issuing volume delete {{(pid=87356) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-01ab6440-d004-4b79-a338-bf7b620da00f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-01ab6440-d004-4b79-a338-bf7b620da00f" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[579d5f19-5dc7-4b4c-a937-51124e292fe5]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:11 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f Sep 25 11:36:11 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:12 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f" returned: 0 in 1.046s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:12 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f Sep 25 11:36:12 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:12 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-01ab6440-d004-4b79-a338-bf7b620da00f" returned: 0 in 0.583s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-01ab6440-d004-4b79-a338-bf7b620da00f" released by "delete_volume" :: held 1.777s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:13 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Created reservations ['e5010625-309a-4c28-82b0-1435dae2e085', '8dbe7052-abd2-4545-aeab-491cd470fbef', '4aa27ac7-6304-4dc4-8bf3-babc68088973', '37560a54-ae5a-444f-8075-b3f11092dc3a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:13 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:36:13 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:14 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.595s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:14 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Deleted volume successfully. Sep 25 11:36:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2c706b0c-7761-4534-952c-989ddb89a69e tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-01ab6440-d004-4b79-a338-bf7b620da00f-delete_volume" released by "delete_volume" :: held 6.897s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-abb53bad-0d58-42fc-bf30-fdb6006fd6fe-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-abb53bad-0d58-42fc-bf30-fdb6006fd6fe-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "cinder-quobyte-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:15 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aedf52-4c74-47a6-94ca-69cfee211498]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:15 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe Sep 25 11:36:15 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:15 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" returned: 0 in 0.573s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:15 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe Sep 25 11:36:15 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:16 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" returned: 0 in 0.668s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-quobyte-abb53bad-0d58-42fc-bf30-fdb6006fd6fe" released by "delete_volume" :: held 1.327s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Created reservations ['fae9bff6-140a-486d-8927-57e6d597761b', 'efaaa1d3-e6d2-4ceb-83be-9892083c1020', 'a888bb37-9522-41ad-9de0-e6833da61012', 'a59b1c4b-b656-4e22-a083-9c19ced115ee'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:16 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:36:16 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:17 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.567s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:17 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Deleted volume successfully. Sep 25 11:36:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61ee4c80-2604-4ddb-9416-df59e8765497 tempest-VolumesDeleteCascade-353335356 None] Lock "cinder-abb53bad-0d58-42fc-bf30-fdb6006fd6fe-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:23 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:36:23 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:23 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.485s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 8 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:36:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Flow 'volume_create_manager' (4c78f279-8b9f-4680-ad2e-5da893ef24e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58895a12-c3f3-4b46-a8c0-675e0576a0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58895a12-c3f3-4b46-a8c0-675e0576a0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-899435856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097061fb-e17b-4834-bf85-50b4c24f4383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1c2aa620cd4b55915153669b5c2daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:25Z,use_quota=True,user_id='d9fd0be22f214bf99c45a23839303a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1e7425-3012-469b-9a65-dde7737abe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1e7425-3012-469b-9a65-dde7737abe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289211b1-5487-46be-9799-8f6910184c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289211b1-5487-46be-9799-8f6910184c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097061fb-e17b-4834-bf85-50b4c24f4383', 'volume_name': 'volume-097061fb-e17b-4834-bf85-50b4c24f4383', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260a0b76-855c-4acc-afef-79ecda236d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260a0b76-855c-4acc-afef-79ecda236d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b55f7d-7d63-45cc-b1bb-28975722dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:24 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Volume 097061fb-e17b-4834-bf85-50b4c24f4383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097061fb-e17b-4834-bf85-50b4c24f4383', 'volume_size': 1} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-899435856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097061fb-e17b-4834-bf85-50b4c24f4383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1c2aa620cd4b55915153669b5c2daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:25Z,use_quota=True,user_id='d9fd0be22f214bf99c45a23839303a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Creating volume 097061fb-e17b-4834-bf85-50b4c24f4383 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:36:24 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:36:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:24 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 1073741824 Sep 25 11:36:24 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:25 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 1073741824" returned: 0 in 0.860s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:25 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 Sep 25 11:36:25 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:26 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383" returned: 0 in 0.407s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:36:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b55f7d-7d63-45cc-b1bb-28975722dd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097061fb-e17b-4834-bf85-50b4c24f4383', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4124ad29-3596-41fc-92de-983b8c035621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:26 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Volume volume-097061fb-e17b-4834-bf85-50b4c24f4383 (097061fb-e17b-4834-bf85-50b4c24f4383): created successfully Sep 25 11:36:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4124ad29-3596-41fc-92de-983b8c035621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Flow 'volume_create_manager' (4c78f279-8b9f-4680-ad2e-5da893ef24e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-cd815e83-5494-47fb-b08c-3d94ab837084 tempest-VolumesMetadataTest-1000057022 None] Created volume successfully. Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Acquiring lock "cinder-097061fb-e17b-4834-bf85-50b4c24f4383-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Lock "cinder-097061fb-e17b-4834-bf85-50b4c24f4383-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Acquiring lock "cinder-quobyte-097061fb-e17b-4834-bf85-50b4c24f4383" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Lock "cinder-quobyte-097061fb-e17b-4834-bf85-50b4c24f4383" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a2a30a-ec05-4c4b-bc2a-83e85ee4539d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:28 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 Sep 25 11:36:28 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:28 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383" returned: 0 in 0.450s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:28 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383 Sep 25 11:36:28 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:28 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-097061fb-e17b-4834-bf85-50b4c24f4383" returned: 0 in 0.340s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Lock "cinder-quobyte-097061fb-e17b-4834-bf85-50b4c24f4383" released by "delete_volume" :: held 0.857s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=112,cinder:SELECT=106,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=90,cinder:UPDATE=109,cinder:DELETE=8,cinder:INSERT=26 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Created reservations ['584a5f8d-af64-4814-be14-a0e6b3fba45f', 'dbde751b-43cb-4007-b3c7-5d3673ad7f37', '8c33c17c-d905-478a-be99-3bbccb81591b', '819e4b26-aead-4e46-b564-e6c33973604d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:29 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:36:29 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:29 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.492s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Deleted volume successfully. Sep 25 11:36:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af3a2e90-2887-40ae-afe7-2cad0827fa44 tempest-VolumesMetadataTest-1000057022 None] Lock "cinder-097061fb-e17b-4834-bf85-50b4c24f4383-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Flow 'volume_create_manager' (31440912-594e-444d-a290-8a6529d414d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5e536d-4b26-41f4-977e-41f728f95797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5e536d-4b26-41f4-977e-41f728f95797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-747481295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015a2bf8-0aa1-4891-928a-741a9c031fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feae424b3de0477da1e68943351e6fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:30Z,use_quota=True,user_id='f846a666113f41749b5b2b01969c6a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c37b2-4795-43d5-bc6a-9afcaf19a057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c37b2-4795-43d5-bc6a-9afcaf19a057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52db6d3-119a-45ea-96c0-20cc16b83cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52db6d3-119a-45ea-96c0-20cc16b83cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015a2bf8-0aa1-4891-928a-741a9c031fce', 'volume_name': 'volume-015a2bf8-0aa1-4891-928a-741a9c031fce', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e2a825-ce16-43dc-ba45-10a6c92c4f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e2a825-ce16-43dc-ba45-10a6c92c4f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e0b229-7e4f-4893-8f53-616f33b3866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:30 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Volume 015a2bf8-0aa1-4891-928a-741a9c031fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015a2bf8-0aa1-4891-928a-741a9c031fce', 'volume_size': 1} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-747481295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015a2bf8-0aa1-4891-928a-741a9c031fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feae424b3de0477da1e68943351e6fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:30Z,use_quota=True,user_id='f846a666113f41749b5b2b01969c6a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Creating volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:36:30 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:36:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:30 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce 1073741824 Sep 25 11:36:30 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:31 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce 1073741824" returned: 0 in 0.590s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:31 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce Sep 25 11:36:31 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:31 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce" returned: 0 in 0.353s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e0b229-7e4f-4893-8f53-616f33b3866e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015a2bf8-0aa1-4891-928a-741a9c031fce', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2c0648-6556-4ccc-8143-ff043fa9f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Volume volume-015a2bf8-0aa1-4891-928a-741a9c031fce (015a2bf8-0aa1-4891-928a-741a9c031fce): created successfully Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2c0648-6556-4ccc-8143-ff043fa9f823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Flow 'volume_create_manager' (31440912-594e-444d-a290-8a6529d414d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ab9dd731-c556-44ac-b3cc-4a63215b7b63 tempest-SnapshotsActionsTest-396356416 None] Created volume successfully. Sep 25 11:36:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Creating offline snapshot 9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:36:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c807c7c6-a374-4023-a4e5-1386ec28ce00]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:33 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce Sep 25 11:36:33 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:33 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce" returned: 0 in 0.633s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:33 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 1G Sep 25 11:36:33 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:34 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 1G" returned: 0 in 0.648s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:34 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:36:34 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:34 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.423s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:34 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 is being set with open permissions: ugo+rw Sep 25 11:36:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:34 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:36:34 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:35 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.522s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:35 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.info Sep 25 11:36:35 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:35 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.info" returned: 0 in 0.566s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:35 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.info is being set with open permissions: ugo+rw Sep 25 11:36:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:35 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.info Sep 25 11:36:35 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:36 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.info" returned: 0 in 0.508s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.482s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ef90d6d1-53d1-4081-a55b-61282e87bb24 tempest-SnapshotsActionsTest-396356416 None] Create snapshot completed successfully Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Flow 'volume_create_manager' (f2ba14a6-1d61-4efd-8eff-421f25b53ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23a008b-24df-4c9c-ab61-861d81b20f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23a008b-24df-4c9c-ab61-861d81b20f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2071993029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b365aec46cb471a9fcd8a4cbdf45eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:38Z,use_quota=True,user_id='1e653b14874147c485ae5bb890bcbcaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d591898-6a3a-4297-83c2-1c30c09209b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d591898-6a3a-4297-83c2-1c30c09209b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5fe311-3a13-4bfc-a798-3b7805ac31df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5fe311-3a13-4bfc-a798-3b7805ac31df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821', 'volume_name': 'volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b9aa4d-b3c0-4c60-a45a-bd64e56247dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b9aa4d-b3c0-4c60-a45a-bd64e56247dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dafced2-85bb-4753-8b5b-55ccc75566cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:37 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Volume 632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821', 'volume_size': 1} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2071993029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b365aec46cb471a9fcd8a4cbdf45eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:38Z,use_quota=True,user_id='1e653b14874147c485ae5bb890bcbcaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Creating volume 632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:36:37 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:36:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:38 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 1073741824 Sep 25 11:36:38 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:38 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 1073741824" returned: 0 in 0.868s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:38 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:36:38 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 Sep 25 11:36:38 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Flow 'volume_create_manager' (454fabcf-ffcd-4fb7-a7d6-5c11cd2beddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429b6f54-450b-4857-afe8-6b20b71920a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429b6f54-450b-4857-afe8-6b20b71920a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-414372025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33ca9cb-b3e4-4646-bec5-c005ab9873ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aedfc4a73b42308e2a195371d80315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:39Z,use_quota=True,user_id='abea6b3af01c4fcea6db2610734949fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272f0a3d-ca8e-4bad-a27a-8c94ab5444e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272f0a3d-ca8e-4bad-a27a-8c94ab5444e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6080fc44-7db7-4262-b9d0-7eb69bff2d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6080fc44-7db7-4262-b9d0-7eb69bff2d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33ca9cb-b3e4-4646-bec5-c005ab9873ef', 'volume_name': 'volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591dda6b-5c56-4473-ad77-610af02198e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591dda6b-5c56-4473-ad77-610af02198e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43e4e1e-2ee3-41fc-9e0e-205de3b45f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:39 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Volume b33ca9cb-b3e4-4646-bec5-c005ab9873ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef', 'volume_size': 1} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:39 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821" returned: 0 in 0.371s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.907s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dafced2-85bb-4753-8b5b-55ccc75566cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c259e7-1c3d-4a99-ab06-133123d3213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Creating offline snapshot 2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:36:39 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Volume volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 (632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821): created successfully Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c259e7-1c3d-4a99-ab06-133123d3213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Flow 'volume_create_manager' (f2ba14a6-1d61-4efd-8eff-421f25b53ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f6ba2-b178-4554-b7dc-c97e8dd8f467]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:39 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-52787acb-5f0c-40d0-9604-8023867ac5da tempest-ServerActionsTestOtherA-323548451 None] Created volume successfully. Sep 25 11:36:39 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:36:39 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:39 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.508s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:36:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:39 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 1G Sep 25 11:36:39 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:40 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 1G" returned: 0 in 0.658s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:40 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 Sep 25 11:36:40 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:40 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422" returned: 0 in 0.384s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:40 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 is being set with open permissions: ugo+rw Sep 25 11:36:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:41 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 Sep 25 11:36:41 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:41 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422" returned: 0 in 0.332s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.341s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-414372025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33ca9cb-b3e4-4646-bec5-c005ab9873ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aedfc4a73b42308e2a195371d80315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:39Z,use_quota=True,user_id='abea6b3af01c4fcea6db2610734949fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Creating volume b33ca9cb-b3e4-4646-bec5-c005ab9873ef {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:36:41 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:36:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:41 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef 1073741824 Sep 25 11:36:41 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:41 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ecb35a35-43d3-4032-b0df-955b27699bb2 tempest-SnapshotsActionsTest-396356416 None] Create snapshot completed successfully Sep 25 11:36:42 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef 1073741824" returned: 0 in 0.646s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:42 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef Sep 25 11:36:42 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:42 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef" returned: 0 in 0.315s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43e4e1e-2ee3-41fc-9e0e-205de3b45f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bcb1f9-01a1-426a-9e1d-077a44ebef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Volume volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef (b33ca9cb-b3e4-4646-bec5-c005ab9873ef): created successfully Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bcb1f9-01a1-426a-9e1d-077a44ebef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Flow 'volume_create_manager' (454fabcf-ffcd-4fb7-a7d6-5c11cd2beddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:42 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b24fa75d-1c1b-4f3d-a784-550b37467653 tempest-VolumesTransfersV355Test-1787898218 None] Created volume successfully. Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-quobyte-2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Deleting offline snapshot 2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] snapshot_file for this snap is: volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba850444-345b-4558-a17c-0a66e18f8b18]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:43 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 Sep 25 11:36:43 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:43 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422" returned: 0 in 0.655s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:36:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d91abe-c5d4-449b-a445-a2b9992cbb24]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:43 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:36:43 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:44 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.796s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:36:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:44 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 Sep 25 11:36:44 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6a218790-6b63-48e9-945d-2cfc88cbb260 tempest-VolumesTransfersV355Test-1741437680 None] Transfer volume completed successfully. Sep 25 11:36:45 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422" returned: 0 in 0.616s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:45 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422 Sep 25 11:36:45 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:45 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422" released by "_delete_snapshot" :: held 2.720s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" released by "delete_snapshot" :: held 2.763s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Created reservations ['47a45bb7-1f81-4ab3-9b5b-17b2fcf80811', '40db200b-b9f6-489d-8914-73abefbcc3d5', '9a9f2389-ba9e-4265-85c5-a8dc80c2ac80', '561aa426-c7cb-481f-ae3d-bfac86051d35'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Delete snapshot completed successfully. Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8565d141-2d6e-46cf-a5de-88de96bb8cff tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-2c6fdffd-d5fb-4ab1-af6f-0d4f8e3df422-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Acquiring lock "cinder-b33ca9cb-b3e4-4646-bec5-c005ab9873ef-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Lock "cinder-b33ca9cb-b3e4-4646-bec5-c005ab9873ef-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Acquiring lock "cinder-quobyte-b33ca9cb-b3e4-4646-bec5-c005ab9873ef" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Lock "cinder-quobyte-b33ca9cb-b3e4-4646-bec5-c005ab9873ef" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e1168b-926e-49d1-bda2-6c7c46d9c6aa]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:46 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef Sep 25 11:36:46 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:46 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef" returned: 0 in 0.645s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Creating offline snapshot b4d32f38-3268-47cc-b147-4853f41668ad of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:36:46 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef Sep 25 11:36:46 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[90df69b4-a362-4858-b312-0845236d5b79]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:46 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:36:46 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:47 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b33ca9cb-b3e4-4646-bec5-c005ab9873ef" returned: 0 in 0.353s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Lock "cinder-quobyte-b33ca9cb-b3e4-4646-bec5-c005ab9873ef" released by "delete_volume" :: held 1.107s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Created reservations ['df469f50-a57c-4daa-a75e-39039c1de695', '9effad20-7df5-48b6-99df-916e87f63b60', 'e177ca51-a277-4051-ad89-c5d316605584', '4730dff2-ac37-4f6e-9074-60b2fc873efc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:47 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:36:47 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:47 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.650s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:47 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad 1G Sep 25 11:36:47 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:47 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.368s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Deleted volume successfully. Sep 25 11:36:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad36be71-44d4-4f06-a530-8cce2a1bebb7 tempest-VolumesTransfersV355Test-362845905 None] Lock "cinder-b33ca9cb-b3e4-4646-bec5-c005ab9873ef-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:48 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad 1G" returned: 0 in 0.745s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:48 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad Sep 25 11:36:48 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:48 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad" returned: 0 in 0.666s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:48 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad is being set with open permissions: ugo+rw Sep 25 11:36:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:48 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad Sep 25 11:36:48 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:49 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad" returned: 0 in 0.867s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.143s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Flow 'volume_create_manager' (b70e7dea-7e66-4774-bd53-faee14c0b15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33b64c2-ebfa-4521-8926-002936c9e4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33b64c2-ebfa-4521-8926-002936c9e4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1047051693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a6abf-16b2-49d6-b6fc-839685be2681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aedfc4a73b42308e2a195371d80315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:50Z,use_quota=True,user_id='abea6b3af01c4fcea6db2610734949fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3841381a-243f-4f6c-84f9-e2fe92750540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3841381a-243f-4f6c-84f9-e2fe92750540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db79114d-3af9-4cf8-a5fe-a39309248e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db79114d-3af9-4cf8-a5fe-a39309248e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57a6abf-16b2-49d6-b6fc-839685be2681', 'volume_name': 'volume-c57a6abf-16b2-49d6-b6fc-839685be2681', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1327cb-9efd-41bc-9b27-b46c71701684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1327cb-9efd-41bc-9b27-b46c71701684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d15c546-6d51-419f-b5a7-b0a9f8c58c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Volume c57a6abf-16b2-49d6-b6fc-839685be2681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57a6abf-16b2-49d6-b6fc-839685be2681', 'volume_size': 1} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1047051693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a6abf-16b2-49d6-b6fc-839685be2681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aedfc4a73b42308e2a195371d80315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:36:50Z,use_quota=True,user_id='abea6b3af01c4fcea6db2610734949fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Creating volume c57a6abf-16b2-49d6-b6fc-839685be2681 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:36:49 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:36:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d7b35dff-a4bf-4643-b246-47cab8c70065 tempest-SnapshotsActionsTest-396356416 None] Create snapshot completed successfully Sep 25 11:36:50 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 1073741824 Sep 25 11:36:50 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:50 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 1073741824" returned: 0 in 0.784s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:50 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 Sep 25 11:36:50 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:51 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d15c546-6d51-419f-b5a7-b0a9f8c58c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57a6abf-16b2-49d6-b6fc-839685be2681', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7442c3f7-a89a-49bf-adc4-f773824cebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:36:51 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Volume volume-c57a6abf-16b2-49d6-b6fc-839685be2681 (c57a6abf-16b2-49d6-b6fc-839685be2681): created successfully Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7442c3f7-a89a-49bf-adc4-f773824cebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Flow 'volume_create_manager' (b70e7dea-7e66-4774-bd53-faee14c0b15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-b4d32f38-3268-47cc-b147-4853f41668ad-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:51 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-193f1190-943a-451d-b858-200c3ba7b7d0 tempest-VolumesTransfersV355Test-1787898218 None] Created volume successfully. Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-b4d32f38-3268-47cc-b147-4853f41668ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-quobyte-b4d32f38-3268-47cc-b147-4853f41668ad" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-b4d32f38-3268-47cc-b147-4853f41668ad" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Deleting offline snapshot b4d32f38-3268-47cc-b147-4853f41668ad of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] snapshot_file for this snap is: volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4272e7-589f-4de8-b58b-e2af5282e556]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:51 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad Sep 25 11:36:51 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:52 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad" returned: 0 in 0.687s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Acquiring lock "cinder-c57a6abf-16b2-49d6-b6fc-839685be2681-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d192d-3264-4b08-a7a0-ca6dbf1c0a29]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Lock "cinder-c57a6abf-16b2-49d6-b6fc-839685be2681-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Acquiring lock "cinder-quobyte-c57a6abf-16b2-49d6-b6fc-839685be2681" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Lock "cinder-quobyte-c57a6abf-16b2-49d6-b6fc-839685be2681" acquired by "delete_volume" :: waited 0.044s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:36:52 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:36:52 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56021594-e4f8-4dd3-873b-805dc8003148]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:52 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 Sep 25 11:36:52 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:52 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.521s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:52 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad Sep 25 11:36:52 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:52 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681" returned: 0 in 0.503s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:52 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681 Sep 25 11:36:52 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:53 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c57a6abf-16b2-49d6-b6fc-839685be2681" returned: 0 in 0.622s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:53 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad" returned: 0 in 0.866s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Lock "cinder-quobyte-c57a6abf-16b2-49d6-b6fc-839685be2681" released by "delete_volume" :: held 1.285s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:53 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad Sep 25 11:36:53 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:53 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Created reservations ['97671674-10d7-4b3a-b412-1357abefb394', 'c412ab2a-d1ee-481e-89fd-effda4fcc5ae', '0564d686-08b8-41ad-baa0-728dde1a7e83', '6021bb99-8b4e-4522-b342-aa12226f7eee'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:54 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:36:54 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:54 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.b4d32f38-3268-47cc-b147-4853f41668ad" returned: 0 in 0.850s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-b4d32f38-3268-47cc-b147-4853f41668ad" released by "_delete_snapshot" :: held 3.175s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" released by "delete_snapshot" :: held 3.231s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Created reservations ['2c2e5ed2-502b-47ba-a5c9-69a1072d04df', '7ce39c06-0c94-4f97-b877-7cebc024b0cb', '2dae53ef-6da4-43f3-bc1d-6467a9c962a3', '959a9e73-8c47-47d0-83b8-1c9e31e8a4a0'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:36:54 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.632s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Deleted volume successfully. Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ab0af6ff-e70e-42c6-bcae-e470fd5c8613 tempest-VolumesTransfersV355Test-362845905 None] Lock "cinder-c57a6abf-16b2-49d6-b6fc-839685be2681-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Delete snapshot completed successfully. Sep 25 11:36:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9316c7aa-2b6b-4ef9-933a-5a694874b25c tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-b4d32f38-3268-47cc-b147-4853f41668ad-delete_snapshot" released by "delete_snapshot" :: held 3.605s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:36:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Creating offline snapshot ce1bdf31-cb02-48f3-887b-96eb0478769b of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:36:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c15d7a6-9ff7-4982-bcba-7cfb3403a0b3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:36:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:56 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:36:56 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:57 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.982s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:36:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:57 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b 1G Sep 25 11:36:57 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:58 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b 1G" returned: 0 in 0.978s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:58 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b Sep 25 11:36:58 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:59 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b" returned: 0 in 0.676s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:59 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b is being set with open permissions: ugo+rw Sep 25 11:36:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:59 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b Sep 25 11:36:59 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:59 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b" returned: 0 in 0.505s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.382s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:59 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c2d81108-52e9-4a77-a44c-9ab416608637 tempest-SnapshotsActionsTest-396356416 None] Create snapshot completed successfully Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-ce1bdf31-cb02-48f3-887b-96eb0478769b-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-ce1bdf31-cb02-48f3-887b-96eb0478769b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-quobyte-ce1bdf31-cb02-48f3-887b-96eb0478769b" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-ce1bdf31-cb02-48f3-887b-96eb0478769b" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Deleting offline snapshot ce1bdf31-cb02-48f3-887b-96eb0478769b of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] snapshot_file for this snap is: volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9942fb3-8924-4417-9653-7b68c9ad97bd]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:01 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b Sep 25 11:37:01 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:01 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b" returned: 0 in 0.632s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:37:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d25db-da26-4e55-9a2e-c22b898f8d57]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:02 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:37:02 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:02 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.516s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:37:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:02 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b Sep 25 11:37:02 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:03 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b" returned: 0 in 0.618s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:03 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b Sep 25 11:37:03 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:03 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.ce1bdf31-cb02-48f3-887b-96eb0478769b" returned: 0 in 0.511s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-ce1bdf31-cb02-48f3-887b-96eb0478769b" released by "_delete_snapshot" :: held 2.513s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" released by "delete_snapshot" :: held 2.581s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:03 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Created reservations ['7417484f-91eb-4eb9-a8f8-7f54955e3f6b', '2e1fb7c6-af89-4d64-9804-e8db7b98c213', '32b9e238-1052-4fea-8d6b-4bf4ab2fd0b5', 'b5f51077-5338-4b76-b97c-c08c59c1a997'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:37:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Delete snapshot completed successfully. Sep 25 11:37:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-144f1357-ec53-4bec-b409-5900e29267f0 tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-ce1bdf31-cb02-48f3-887b-96eb0478769b-delete_snapshot" released by "delete_snapshot" :: held 2.894s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Creating offline snapshot d5c934d5-2d35-482a-9fa3-643600e799e6 of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:37:05 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54845c8-26f9-4260-915a-ab21076db63a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:05 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:37:05 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:05 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.458s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:37:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:05 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 1G Sep 25 11:37:05 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:06 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 1G" returned: 0 in 0.694s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:06 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 Sep 25 11:37:06 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:06 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6" returned: 0 in 0.489s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:06 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 is being set with open permissions: ugo+rw Sep 25 11:37:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:06 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 Sep 25 11:37:06 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:07 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6" returned: 0 in 0.477s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a91b4814-9dc1-4bc9-832b-3b2ed9758786 tempest-SnapshotsActionsTest-396356416 None] Create snapshot completed successfully Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-d5c934d5-2d35-482a-9fa3-643600e799e6-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-d5c934d5-2d35-482a-9fa3-643600e799e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Acquiring lock "cinder-quobyte-d5c934d5-2d35-482a-9fa3-643600e799e6" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-d5c934d5-2d35-482a-9fa3-643600e799e6" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Deleting offline snapshot d5c934d5-2d35-482a-9fa3-643600e799e6 of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] snapshot_file for this snap is: volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[239546da-df18-4735-b052-f77a972084db]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:08 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 Sep 25 11:37:08 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Flow 'volume_create_manager' (71d95626-ea40-41e3-883f-f5728ef3e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ece866-2158-4623-b1ac-53366920d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ece866-2158-4623-b1ac-53366920d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1956288213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0163a0-6cc3-437a-acb2-109a405d3469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bedf28458b54199a26d68e0697f7303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:09Z,use_quota=True,user_id='6cbd5f31f1b24f7190f1949b03eb3f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1e79f9-745d-45d9-b584-59571aa75f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1e79f9-745d-45d9-b584-59571aa75f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc620c5-3656-480b-9f5c-2b589602e740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:08 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:37:09 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6" returned: 0 in 0.552s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[02213b6b-11a4-4a9e-af0f-de0fc0f0af63]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:09 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:37:09 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc620c5-3656-480b-9f5c-2b589602e740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e0163a0-6cc3-437a-acb2-109a405d3469', 'volume_name': 'volume-7e0163a0-6cc3-437a-acb2-109a405d3469', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a606e8-8a6d-4722-ad2d-9b15a9fcc1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a606e8-8a6d-4722-ad2d-9b15a9fcc1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d817075-cceb-4199-bfcd-0d1b376aa904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Volume 7e0163a0-6cc3-437a-acb2-109a405d3469: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e0163a0-6cc3-437a-acb2-109a405d3469', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Trying to clone 7e0163a0-6cc3-437a-acb2-109a405d3469 from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:37:09 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.547s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:09 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 Sep 25 11:37:09 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:37:09 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dd28a2-1ec4-4916-a5b6-babfe23fdd77]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:10 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD Sep 25 11:37:10 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:10 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6" returned: 0 in 0.398s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:10 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6 Sep 25 11:37:10 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:10 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 is fetched for user 6cbd5f31f1b24f7190f1949b03eb3f1b. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d4998a-6469-49f7-96b1-31472e4767e7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:10 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.d5c934d5-2d35-482a-9fa3-643600e799e6" returned: 0 in 0.286s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-d5c934d5-2d35-482a-9fa3-643600e799e6" released by "_delete_snapshot" :: held 1.958s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" released by "delete_snapshot" :: held 2.020s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:10 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD Sep 25 11:37:10 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Created reservations ['afe001b9-5089-4aa5-8c5b-645a8a3a267a', '6f5f8c75-f577-4f83-9291-61af4f7ce56e', '311d2e8d-0afb-4d06-a039-35c2a46c2d5f', 'ea213d3a-ea69-4c94-8872-7b3e389f51c5'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:37:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Delete snapshot completed successfully. Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e1f9424-90fe-421e-aab8-9c86eb7e0f7e tempest-SnapshotsActionsTest-51353683 None] Lock "cinder-d5c934d5-2d35-482a-9fa3-643600e799e6-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:10 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1956288213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0163a0-6cc3-437a-acb2-109a405d3469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bedf28458b54199a26d68e0697f7303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:09Z,use_quota=True,user_id='6cbd5f31f1b24f7190f1949b03eb3f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Creating volume 7e0163a0-6cc3-437a-acb2-109a405d3469 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:37:10 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:37:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:10 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 1073741824 Sep 25 11:37:10 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:11 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 1073741824" returned: 0 in 0.442s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:11 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 Sep 25 11:37:11 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:11 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469" returned: 0 in 0.269s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Attempting download of 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume 7e0163a0-6cc3-437a-acb2-109a405d3469. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14b49b4-5d8d-4a7c-89cc-b6ef1c2277c6]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_14zjki04 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:11 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_14zjki04 Sep 25 11:37:11 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:11 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_14zjki04" returned: 0 in 0.377s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_14zjki04 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:12 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_14zjki04 Sep 25 11:37:12 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "cinder-9bdb0b1e-7de6-4ff7-9516-f3875cb59b85-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-9bdb0b1e-7de6-4ff7-9516-f3875cb59b85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "cinder-quobyte-9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-quobyte-9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Deleting offline snapshot 9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 of volume 015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] snapshot_file for this snap is: volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7f1cd3-00b7-479f-8861-3374cba5cc0e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:12 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_14zjki04" returned: 1 in 0.416s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_14zjki04' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[de82ba04-413f-4a26-97cb-e194925c31ce]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:12 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:37:12 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:12 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD Sep 25 11:37:12 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:12 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.410s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015a2bf8-0aa1-4891-928a-741a9c031fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc2722d-9c8a-427f-93c4-e514ae23b7b7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:12 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] 52fc0ca7-cc30-4877-96ee-a5ea6e458871 was qcow2, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:37:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:12 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 Sep 25 11:37:12 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:12 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce Sep 25 11:37:12 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:13 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce" returned: 0 in 0.433s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:13 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:37:13 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:13 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.391s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:13 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85 Sep 25 11:37:13 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:13 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce.9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" returned: 0 in 0.292s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-quobyte-9bdb0b1e-7de6-4ff7-9516-f3875cb59b85" released by "_delete_snapshot" :: held 1.702s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" released by "delete_snapshot" :: held 1.739s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:14 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Created reservations ['22da0fec-c8f1-428c-904a-16ec838bbf14', 'f830298d-aa46-4b89-ab09-9ab600c89490', '41e9261c-1b37-4ff9-be1c-e9720aba664d', '3ff42dba-351a-4c86-884c-84b2e39da4b2'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:37:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Delete snapshot completed successfully. Sep 25 11:37:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d5de9b4d-3946-4193-b18b-3ffd4835e930 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-9bdb0b1e-7de6-4ff7-9516-f3875cb59b85-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "cinder-015a2bf8-0aa1-4891-928a-741a9c031fce-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-015a2bf8-0aa1-4891-928a-741a9c031fce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b22fa9-92b8-4ed7-b24d-fb45f6fae687]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:14 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce Sep 25 11:37:14 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:15 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce" returned: 0 in 0.534s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:15 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce Sep 25 11:37:15 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:15 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469" returned: 0 in 2.543s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_t6temexndevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:37:15 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Converted 112.00 MB image at 44.02 MB/s Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:15 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 1G Sep 25 11:37:15 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:15 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-015a2bf8-0aa1-4891-928a-741a9c031fce" returned: 0 in 0.434s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-quobyte-015a2bf8-0aa1-4891-928a-741a9c031fce" released by "delete_volume" :: held 1.096s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Created reservations ['56160f7b-e1de-408c-8eed-3fbbbc4297ca', '782e752d-2d11-4495-86e5-fb78863bab91', '7830f70b-7dfe-4e26-98ad-46d1b78a5130', '4da4a179-37fb-410b-b04b-470cde4ddf6e'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:15 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:37:15 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:15 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 1G" returned: 0 in 0.504s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Downloaded image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume 7e0163a0-6cc3-437a-acb2-109a405d3469 successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 for user 6cbd5f31f1b24f7190f1949b03eb3f1b is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Marking volume 7e0163a0-6cc3-437a-acb2-109a405d3469 as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Copying metadata from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 to 7e0163a0-6cc3-437a-acb2-109a405d3469. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Creating volume glance metadata for volume 7e0163a0-6cc3-437a-acb2-109a405d3469 backed by image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d817075-cceb-4199-bfcd-0d1b376aa904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0163a0-6cc3-437a-acb2-109a405d3469', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df99eab8-79e7-4414-b0e6-e4491774d46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:16 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Volume volume-7e0163a0-6cc3-437a-acb2-109a405d3469 (7e0163a0-6cc3-437a-acb2-109a405d3469): created successfully Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df99eab8-79e7-4414-b0e6-e4491774d46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Flow 'volume_create_manager' (71d95626-ea40-41e3-883f-f5728ef3e034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-de906706-70d9-4802-9a90-b2f699e27079 tempest-VolumesExtendTest-770437944 None] Created volume successfully. Sep 25 11:37:16 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.410s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:37:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Deleted volume successfully. Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff8dbfa0-539f-4d2d-8eba-9e3a30be8fb3 tempest-SnapshotsActionsTest-396356416 None] Lock "cinder-015a2bf8-0aa1-4891-928a-741a9c031fce-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48d9d54e-17ef-4c38-877e-335edf7a174d tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48d9d54e-17ef-4c38-877e-335edf7a174d tempest-VolumesExtendTest-770437944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b8fc0e-60dc-4b3d-a175-17a033b74393]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48d9d54e-17ef-4c38-877e-335edf7a174d tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:16 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 Sep 25 11:37:16 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:16 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48d9d54e-17ef-4c38-877e-335edf7a174d tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469" returned: 0 in 0.462s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48d9d54e-17ef-4c38-877e-335edf7a174d tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 2G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48d9d54e-17ef-4c38-877e-335edf7a174d tempest-VolumesExtendTest-770437944 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 2G" returned: 0 in 0.161s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48d9d54e-17ef-4c38-877e-335edf7a174d tempest-VolumesExtendTest-770437944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.652s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-48d9d54e-17ef-4c38-877e-335edf7a174d tempest-VolumesExtendTest-770437944 None] Extend volume completed successfully. Sep 25 11:37:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Acquiring lock "cinder-7e0163a0-6cc3-437a-acb2-109a405d3469-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Lock "cinder-7e0163a0-6cc3-437a-acb2-109a405d3469-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Acquiring lock "cinder-quobyte-7e0163a0-6cc3-437a-acb2-109a405d3469" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Lock "cinder-quobyte-7e0163a0-6cc3-437a-acb2-109a405d3469" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:18 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c8e00-072a-4afe-99c5-b00d3416456f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:18 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 Sep 25 11:37:18 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:18 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469" returned: 0 in 0.423s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:18 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469 Sep 25 11:37:18 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:18 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7e0163a0-6cc3-437a-acb2-109a405d3469" returned: 0 in 0.376s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Lock "cinder-quobyte-7e0163a0-6cc3-437a-acb2-109a405d3469" released by "delete_volume" :: held 0.878s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Created reservations ['b56846fc-6f44-4274-b12c-ec22c6dc9774', '24336c31-fa17-46f8-8131-96b8c3c2f089', '829297bd-6cc9-4cac-bca6-ddaf37c45cb7', 'b0a608b2-5abe-49b5-8fa7-ebee2647fa2e'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:19 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:37:19 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:19 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.472s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:37:19 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Deleted volume successfully. Sep 25 11:37:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71dcd654-ac1c-4801-91df-79e178ff9cfb tempest-VolumesExtendTest-770437944 None] Lock "cinder-7e0163a0-6cc3-437a-acb2-109a405d3469-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Flow 'volume_create_manager' (7727b57c-2803-4df7-b095-ea5791bdd4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb9e528-db77-4110-964d-8a15c643baf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb9e528-db77-4110-964d-8a15c643baf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-880721871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c606d43d-c975-4630-8d3d-d3df4b90c5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bedf28458b54199a26d68e0697f7303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:20Z,use_quota=True,user_id='6cbd5f31f1b24f7190f1949b03eb3f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2865aa4-ce64-4078-b617-2c038e3a04cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2865aa4-ce64-4078-b617-2c038e3a04cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10cb6ad-5c10-466b-803c-89aa72099b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10cb6ad-5c10-466b-803c-89aa72099b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c606d43d-c975-4630-8d3d-d3df4b90c5ec', 'volume_name': 'volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7233b07b-06bd-42ca-9776-514d0c3bce8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7233b07b-06bd-42ca-9776-514d0c3bce8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6c2491-b9c1-492c-9868-11c803e0dd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Volume c606d43d-c975-4630-8d3d-d3df4b90c5ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec', 'volume_size': 1} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-880721871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c606d43d-c975-4630-8d3d-d3df4b90c5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bedf28458b54199a26d68e0697f7303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:20Z,use_quota=True,user_id='6cbd5f31f1b24f7190f1949b03eb3f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Creating volume c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:37:20 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:20 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec 1073741824 Sep 25 11:37:20 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Flow 'volume_create_manager' (2319b6e5-47ce-445e-af3a-2ca0d77f4f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73afc6e3-f0eb-4957-9ab0-3f39fd2512f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73afc6e3-f0eb-4957-9ab0-3f39fd2512f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-486058128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29032c9a-0440-4428-acd8-75b560492995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd529db4775c41e0ae267ce84f83158c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:20Z,use_quota=True,user_id='978a1adda12844d28007432cadabf5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaef8764-7793-4312-8387-8c3f2101e24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaef8764-7793-4312-8387-8c3f2101e24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5357b811-7c46-49c1-8071-d941305ae3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5357b811-7c46-49c1-8071-d941305ae3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29032c9a-0440-4428-acd8-75b560492995', 'volume_name': 'volume-29032c9a-0440-4428-acd8-75b560492995', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb2e042-0bb4-44b9-9275-d7e825c78fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb2e042-0bb4-44b9-9275-d7e825c78fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0a445f-8811-4f2c-9e4e-3b6a998589c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Volume 29032c9a-0440-4428-acd8-75b560492995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29032c9a-0440-4428-acd8-75b560492995', 'volume_size': 1} Sep 25 11:37:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:21 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec 1073741824" returned: 0 in 0.709s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:21 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec Sep 25 11:37:21 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b437c022-22d1-43f3-a650-625e92d7be4c req-d0ca5b5b-a0ee-49d4-846e-475a9d46836c tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:21 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec" returned: 0 in 0.299s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-486058128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29032c9a-0440-4428-acd8-75b560492995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd529db4775c41e0ae267ce84f83158c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:20Z,use_quota=True,user_id='978a1adda12844d28007432cadabf5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Creating volume 29032c9a-0440-4428-acd8-75b560492995 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:37:21 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6c2491-b9c1-492c-9868-11c803e0dd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:21 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 1073741824 Sep 25 11:37:21 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8c9d6b-cc62-4dbf-a981-d047dc8cb03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:21 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Volume volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec (c606d43d-c975-4630-8d3d-d3df4b90c5ec): created successfully Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8c9d6b-cc62-4dbf-a981-d047dc8cb03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Flow 'volume_create_manager' (7727b57c-2803-4df7-b095-ea5791bdd4cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:21 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-303e3913-3920-475d-b3f6-9212222bd583 tempest-VolumesExtendTest-770437944 None] Created volume successfully. Sep 25 11:37:21 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 1073741824" returned: 0 in 0.543s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:22 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 Sep 25 11:37:22 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:22 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995" returned: 0 in 0.361s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b437c022-22d1-43f3-a650-625e92d7be4c req-d0ca5b5b-a0ee-49d4-846e-475a9d46836c tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.228s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0a445f-8811-4f2c-9e4e-3b6a998589c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29032c9a-0440-4428-acd8-75b560492995', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06fb52b-3fc1-40d5-abc5-57a4c695bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:22 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Volume volume-29032c9a-0440-4428-acd8-75b560492995 (29032c9a-0440-4428-acd8-75b560492995): created successfully Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06fb52b-3fc1-40d5-abc5-57a4c695bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Flow 'volume_create_manager' (2319b6e5-47ce-445e-af3a-2ca0d77f4f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b437c022-22d1-43f3-a650-625e92d7be4c req-d0ca5b5b-a0ee-49d4-846e-475a9d46836c tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.132s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.056s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a78b0734-b471-4ebb-9af8-3c5bc11c11ed tempest-AttachVolumeTestJSON-1559194364 None] Created volume successfully. Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Creating offline snapshot dd6fd81e-d1ea-450d-a937-96192a775cbe of volume c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-b437c022-22d1-43f3-a650-625e92d7be4c req-d0ca5b5b-a0ee-49d4-846e-475a9d46836c tempest-ServerActionsTestOtherA-323548451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab6c7c4c-97c6-4a93-8747-f2a43125db38', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c46a34-9405-4dde-912d-963884d13982]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-b437c022-22d1-43f3-a650-625e92d7be4c req-d0ca5b5b-a0ee-49d4-846e-475a9d46836c tempest-ServerActionsTestOtherA-323548451 None] attachment_update completed successfully. Sep 25 11:37:22 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec Sep 25 11:37:22 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:23 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec" returned: 0 in 0.491s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:23 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe 1G Sep 25 11:37:23 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:23 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:37:23 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:23 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.375s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:37:23 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe 1G" returned: 0 in 0.659s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:23 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe Sep 25 11:37:23 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:24 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe" returned: 0 in 0.405s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:24 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe is being set with open permissions: ugo+rw Sep 25 11:37:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:24 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe Sep 25 11:37:24 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:24 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe" returned: 0 in 0.324s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:24 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.info Sep 25 11:37:24 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-21b3b372-970b-4811-9d54-589dcab96d55 req-08accd49-9170-4777-a3dc-98966646fcb7 tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:24 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.info" returned: 0 in 0.305s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:24 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.info is being set with open permissions: ugo+rw Sep 25 11:37:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:24 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.info Sep 25 11:37:24 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:25 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.info" returned: 0 in 0.348s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-21b3b372-970b-4811-9d54-589dcab96d55 req-08accd49-9170-4777-a3dc-98966646fcb7 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.582s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-21b3b372-970b-4811-9d54-589dcab96d55 req-08accd49-9170-4777-a3dc-98966646fcb7 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c5292ce0-e861-413e-a2cf-d4109ed93798 tempest-VolumesExtendTest-770437944 None] Create snapshot completed successfully Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-21b3b372-970b-4811-9d54-589dcab96d55 req-08accd49-9170-4777-a3dc-98966646fcb7 tempest-AttachVolumeTestJSON-1559194364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-29032c9a-0440-4428-acd8-75b560492995', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd052b4f9-61e5-4a57-8dd6-15f235db5313', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:37:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-21b3b372-970b-4811-9d54-589dcab96d55 req-08accd49-9170-4777-a3dc-98966646fcb7 tempest-AttachVolumeTestJSON-1559194364 None] attachment_update completed successfully. Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83c03253-0367-41fa-a60a-eb7edda50a95 tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83c03253-0367-41fa-a60a-eb7edda50a95 tempest-VolumesExtendTest-770437944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c545b-a978-48cc-869c-770acbedbf0d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83c03253-0367-41fa-a60a-eb7edda50a95 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:26 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec Sep 25 11:37:26 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:26 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83c03253-0367-41fa-a60a-eb7edda50a95 tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec" returned: 0 in 0.601s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83c03253-0367-41fa-a60a-eb7edda50a95 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe 2G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83c03253-0367-41fa-a60a-eb7edda50a95 tempest-VolumesExtendTest-770437944 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe 2G" returned: 0 in 0.214s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83c03253-0367-41fa-a60a-eb7edda50a95 tempest-VolumesExtendTest-770437944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.897s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-cf183b6a-0db9-4c4e-97d0-132b096add0a req-5b12e269-36e7-409e-9fe0-6190c7873787 tempest-ServerActionsTestOtherA-323548451 None] Terminate volume connection completed successfully. Sep 25 11:37:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-cf183b6a-0db9-4c4e-97d0-132b096add0a req-5b12e269-36e7-409e-9fe0-6190c7873787 tempest-ServerActionsTestOtherA-323548451 None] Deleting attachment ab6c7c4c-97c6-4a93-8747-f2a43125db38. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:37:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-83c03253-0367-41fa-a60a-eb7edda50a95 tempest-VolumesExtendTest-770437944 None] Extend volume completed successfully. Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Acquiring lock "cinder-dd6fd81e-d1ea-450d-a937-96192a775cbe-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Lock "cinder-dd6fd81e-d1ea-450d-a937-96192a775cbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Acquiring lock "cinder-quobyte-c606d43d-c975-4630-8d3d-d3df4b90c5ec" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Lock "cinder-quobyte-c606d43d-c975-4630-8d3d-d3df4b90c5ec" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Acquiring lock "cinder-quobyte-dd6fd81e-d1ea-450d-a937-96192a775cbe" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Lock "cinder-quobyte-dd6fd81e-d1ea-450d-a937-96192a775cbe" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Deleting offline snapshot dd6fd81e-d1ea-450d-a937-96192a775cbe of volume c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] snapshot_file for this snap is: volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a957211-964b-4568-9e2e-7c4f6e642277]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:27 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe Sep 25 11:37:27 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:28 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe" returned: 0 in 0.793s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:37:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-cf183b6a-0db9-4c4e-97d0-132b096add0a req-16fee457-10f5-47e2-8db6-12d3a4c5884b tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-cf183b6a-0db9-4c4e-97d0-132b096add0a req-16fee457-10f5-47e2-8db6-12d3a4c5884b tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:28 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d29f724-900f-4836-aa59-bc7c4a1a28be]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-cf183b6a-0db9-4c4e-97d0-132b096add0a req-16fee457-10f5-47e2-8db6-12d3a4c5884b tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.069s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-cf183b6a-0db9-4c4e-97d0-132b096add0a req-16fee457-10f5-47e2-8db6-12d3a4c5884b tempest-ServerActionsTestOtherA-323548451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fa613e9-c0d2-46e6-ae52-7c9e20aafb80', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:37:28 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec Sep 25 11:37:28 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:28 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-cf183b6a-0db9-4c4e-97d0-132b096add0a req-16fee457-10f5-47e2-8db6-12d3a4c5884b tempest-ServerActionsTestOtherA-323548451 None] attachment_update completed successfully. Sep 25 11:37:29 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec" returned: 0 in 0.629s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:29 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe Sep 25 11:37:29 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:29 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe" returned: 0 in 0.567s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:29 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe Sep 25 11:37:29 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:29 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec.dd6fd81e-d1ea-450d-a937-96192a775cbe" returned: 0 in 0.305s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:29 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=118,cinder:INSERT=33,cinder:UPDATE=108,cinder:DELETE=5 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:37:29 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:INSERT=29,cinder:UPDATE=105,cinder:SELECT=103,cinder:DELETE=13 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:37:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Lock "cinder-quobyte-dd6fd81e-d1ea-450d-a937-96192a775cbe" released by "_delete_snapshot" :: held 2.537s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Lock "cinder-quobyte-c606d43d-c975-4630-8d3d-d3df4b90c5ec" released by "delete_snapshot" :: held 2.594s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:30 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Created reservations ['4ec7137a-d43b-4d2a-94f2-5b617761f3b9', '9155504a-a4ce-41ed-bcaf-5f58f784078c', 'dacd0a32-acc0-403b-aecf-8f839e6eaed1', 'f6becd6c-1d3d-4e02-987f-79bb60f37cbc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:37:30 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Delete snapshot completed successfully. Sep 25 11:37:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-95dac210-5ba6-41fe-878f-e7ad5827ef9f tempest-VolumesExtendTest-770437944 None] Lock "cinder-dd6fd81e-d1ea-450d-a937-96192a775cbe-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Acquiring lock "cinder-c606d43d-c975-4630-8d3d-d3df4b90c5ec-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Lock "cinder-c606d43d-c975-4630-8d3d-d3df4b90c5ec-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Acquiring lock "cinder-quobyte-c606d43d-c975-4630-8d3d-d3df4b90c5ec" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Lock "cinder-quobyte-c606d43d-c975-4630-8d3d-d3df4b90c5ec" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:31 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c9977a-5493-4f9f-9cfe-b9523fdccd73]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:31 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec Sep 25 11:37:31 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:31 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec" returned: 0 in 0.624s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:31 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec Sep 25 11:37:31 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:32 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c606d43d-c975-4630-8d3d-d3df4b90c5ec" returned: 0 in 0.442s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Lock "cinder-quobyte-c606d43d-c975-4630-8d3d-d3df4b90c5ec" released by "delete_volume" :: held 1.248s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Created reservations ['309e00c8-3551-4720-a33a-7f2ff04e27be', 'dbef0a81-873a-4b35-b05b-4c30f8e9490c', '9789b016-6300-4279-ad0a-04f68315d483', 'fe3d6075-a1a1-40bf-a1ad-82558fa86089'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:32 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:37:32 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:33 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.618s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:33 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:37:33 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Deleted volume successfully. Sep 25 11:37:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3adc10a-fc57-42c5-8b84-5a5c4e518dc1 tempest-VolumesExtendTest-770437944 None] Lock "cinder-c606d43d-c975-4630-8d3d-d3df4b90c5ec-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:42 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=18 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:37:43 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:37:50 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Flow 'volume_create_manager' (620de7e5-51f3-4e56-a625-fbeeadac74c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f0b1e3-45aa-4532-b667-ed93bc4f9c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f0b1e3-45aa-4532-b667-ed93bc4f9c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-495889573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fefae377-94cc-4194-96ec-64b68f5f758c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c04052cd3a743a48a8b10baf795ea1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:51Z,use_quota=True,user_id='dc2bfdcaf08047aa911406f4f67661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61433831-790b-4ccf-8793-ced973907566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61433831-790b-4ccf-8793-ced973907566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a7c98d-f0ef-4d9c-965e-16bfde583b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a7c98d-f0ef-4d9c-965e-16bfde583b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fefae377-94cc-4194-96ec-64b68f5f758c', 'volume_name': 'volume-fefae377-94cc-4194-96ec-64b68f5f758c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18d1509-a6b2-4bb3-8283-8c0f3bbc9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18d1509-a6b2-4bb3-8283-8c0f3bbc9f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffeabb91-0f7b-4de3-b0f6-f70b3baaaf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:51 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Volume fefae377-94cc-4194-96ec-64b68f5f758c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fefae377-94cc-4194-96ec-64b68f5f758c', 'volume_size': 1} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-495889573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fefae377-94cc-4194-96ec-64b68f5f758c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c04052cd3a743a48a8b10baf795ea1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:51Z,use_quota=True,user_id='dc2bfdcaf08047aa911406f4f67661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Creating volume fefae377-94cc-4194-96ec-64b68f5f758c {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:37:51 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:51 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c 1073741824 Sep 25 11:37:51 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:51 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c 1073741824" returned: 0 in 0.640s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:51 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c Sep 25 11:37:51 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:52 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c" returned: 0 in 0.344s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:37:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffeabb91-0f7b-4de3-b0f6-f70b3baaaf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fefae377-94cc-4194-96ec-64b68f5f758c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1513d35-1728-497c-a178-89f785223e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:52 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Volume volume-fefae377-94cc-4194-96ec-64b68f5f758c (fefae377-94cc-4194-96ec-64b68f5f758c): created successfully Sep 25 11:37:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1513d35-1728-497c-a178-89f785223e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Flow 'volume_create_manager' (620de7e5-51f3-4e56-a625-fbeeadac74c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8dbfd165-bcfe-4352-b2de-bf38120af468 tempest-VolumeQuotasAdminTestJSON-598761260 None] Created volume successfully. Sep 25 11:37:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Acquiring lock "cinder-fefae377-94cc-4194-96ec-64b68f5f758c-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "cinder-fefae377-94cc-4194-96ec-64b68f5f758c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Acquiring lock "cinder-quobyte-fefae377-94cc-4194-96ec-64b68f5f758c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "cinder-quobyte-fefae377-94cc-4194-96ec-64b68f5f758c" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:53 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da027c8-01cd-45de-9692-1eb1cee67df9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:53 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c Sep 25 11:37:53 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:53 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c" returned: 0 in 0.477s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:54 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c Sep 25 11:37:54 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:54 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fefae377-94cc-4194-96ec-64b68f5f758c" returned: 0 in 0.312s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "cinder-quobyte-fefae377-94cc-4194-96ec-64b68f5f758c" released by "delete_volume" :: held 0.862s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Created reservations ['a082a301-dddd-46a7-ab12-954bf3313f75', 'dfa34496-9f44-4d0e-9ca9-cf3896e5ff27', '32e30d3b-eaad-40a0-9522-a55303ef0e2b', 'f05b2c50-9175-41f9-9bcc-f9decfc3b221'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:54 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:37:54 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:54 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.422s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:37:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Deleted volume successfully. Sep 25 11:37:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3d77ca1f-9d0f-45af-819d-4e553fd7c1d0 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "cinder-fefae377-94cc-4194-96ec-64b68f5f758c-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Flow 'volume_create_manager' (11d5e7cb-4127-46ef-9489-e8aba64b104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89a70ea-d1ad-47b1-8971-919947d73622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89a70ea-d1ad-47b1-8971-919947d73622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-208696032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c6735a-2e30-4e06-ad09-93f078fa0521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c04052cd3a743a48a8b10baf795ea1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:55Z,use_quota=True,user_id='dc2bfdcaf08047aa911406f4f67661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41db225-8b2d-42dc-b395-ac808c1bc90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41db225-8b2d-42dc-b395-ac808c1bc90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b011c1db-9be3-4036-9c7b-1d70770d5717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b011c1db-9be3-4036-9c7b-1d70770d5717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c6735a-2e30-4e06-ad09-93f078fa0521', 'volume_name': 'volume-43c6735a-2e30-4e06-ad09-93f078fa0521', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6a6b06-6b53-41d6-a142-ccd831ef89b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6a6b06-6b53-41d6-a142-ccd831ef89b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6dd9db-c5c8-4b3a-9b53-944f6ad0fde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:55 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Volume 43c6735a-2e30-4e06-ad09-93f078fa0521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c6735a-2e30-4e06-ad09-93f078fa0521', 'volume_size': 1} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-208696032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c6735a-2e30-4e06-ad09-93f078fa0521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c04052cd3a743a48a8b10baf795ea1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:37:55Z,use_quota=True,user_id='dc2bfdcaf08047aa911406f4f67661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Creating volume 43c6735a-2e30-4e06-ad09-93f078fa0521 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:37:55 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:55 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 1073741824 Sep 25 11:37:55 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:55 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 1073741824" returned: 0 in 0.560s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:56 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 Sep 25 11:37:56 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:56 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521" returned: 0 in 0.373s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:37:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6dd9db-c5c8-4b3a-9b53-944f6ad0fde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c6735a-2e30-4e06-ad09-93f078fa0521', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3233b49f-a5f6-4776-a34c-a08be987dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:37:56 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Volume volume-43c6735a-2e30-4e06-ad09-93f078fa0521 (43c6735a-2e30-4e06-ad09-93f078fa0521): created successfully Sep 25 11:37:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3233b49f-a5f6-4776-a34c-a08be987dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:37:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Flow 'volume_create_manager' (11d5e7cb-4127-46ef-9489-e8aba64b104a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:37:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b7094d85-82cd-4120-9dcd-fb9ea8aacd34 tempest-VolumeQuotasAdminTestJSON-598761260 None] Created volume successfully. Sep 25 11:37:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-17c13d91-b06f-4549-82a1-e98e12a01426 tempest-VolumeQuotasAdminTestJSON-1358408513 None] Transfer volume completed successfully. Sep 25 11:37:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Acquiring lock "cinder-43c6735a-2e30-4e06-ad09-93f078fa0521-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Lock "cinder-43c6735a-2e30-4e06-ad09-93f078fa0521-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Acquiring lock "cinder-quobyte-43c6735a-2e30-4e06-ad09-93f078fa0521" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:37:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Lock "cinder-quobyte-43c6735a-2e30-4e06-ad09-93f078fa0521" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:37:59 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ee0aa-3cbe-43a1-adef-2f41265d442f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:37:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:59 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 Sep 25 11:37:59 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:59 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521" returned: 0 in 0.496s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:59 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521 Sep 25 11:37:59 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:00 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-43c6735a-2e30-4e06-ad09-93f078fa0521" returned: 0 in 0.319s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Lock "cinder-quobyte-43c6735a-2e30-4e06-ad09-93f078fa0521" released by "delete_volume" :: held 0.893s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Created reservations ['50a8e195-044c-4b5e-9526-e48e35275007', 'adeb478f-5384-479a-9115-58f504a0f095', '45c9737c-131c-4562-b58e-fb05c8da36f2', 'd983154c-3ff4-42d3-9c96-bdb2e56d89dc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:00 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:38:00 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:00 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.411s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:00 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Deleted volume successfully. Sep 25 11:38:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5c1c9ebd-de24-4d46-addb-3dadf1c2fa19 tempest-VolumeQuotasAdminTestJSON-1531015291 None] Lock "cinder-43c6735a-2e30-4e06-ad09-93f078fa0521-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Flow 'volume_create_manager' (587801db-d90f-44b7-b181-e8ec55c57f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70175930-cf55-4b64-afdc-438be303dca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70175930-cf55-4b64-afdc-438be303dca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-348216905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1071fb4-211f-4f1e-8a5f-78c2f3136ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3096f8c7bc84cbf8372c244ce68b203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:10Z,use_quota=True,user_id='df3cce948ac64518905cfefa39252c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b6bd27-303e-45ff-9348-891cc5e5a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b6bd27-303e-45ff-9348-891cc5e5a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051e6747-2331-4cbb-9669-67646a6dd449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051e6747-2331-4cbb-9669-67646a6dd449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1071fb4-211f-4f1e-8a5f-78c2f3136ab8', 'volume_name': 'volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50481caa-d08e-4402-95eb-6dc62de4c10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50481caa-d08e-4402-95eb-6dc62de4c10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93926110-0528-4e31-b66e-a5d8ecb504e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:10 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Volume f1071fb4-211f-4f1e-8a5f-78c2f3136ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8', 'volume_size': 1} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-348216905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1071fb4-211f-4f1e-8a5f-78c2f3136ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3096f8c7bc84cbf8372c244ce68b203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:10Z,use_quota=True,user_id='df3cce948ac64518905cfefa39252c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Creating volume f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:10 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:10 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 1073741824 Sep 25 11:38:10 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:10 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 1073741824" returned: 0 in 0.559s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:10 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 Sep 25 11:38:10 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:11 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8" returned: 0 in 0.269s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93926110-0528-4e31-b66e-a5d8ecb504e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6778c5b-90db-43cf-8be5-de4a4d58af69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:11 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Volume volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 (f1071fb4-211f-4f1e-8a5f-78c2f3136ab8): created successfully Sep 25 11:38:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6778c5b-90db-43cf-8be5-de4a4d58af69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Flow 'volume_create_manager' (587801db-d90f-44b7-b181-e8ec55c57f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-7ccb321b-b0a9-4223-b23a-d400cfb44464 tempest-VolumesListAdminTestJSON-1989835186 None] Created volume successfully. Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Flow 'volume_create_manager' (b837fabb-fbf7-49b9-9b80-f28e0052c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c41686-7cef-476b-b9be-a5d448ee9769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c41686-7cef-476b-b9be-a5d448ee9769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2041371622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc9d380-7ad3-4baf-a6d7-2dbbd6895110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3096f8c7bc84cbf8372c244ce68b203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:13Z,use_quota=True,user_id='df3cce948ac64518905cfefa39252c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4c023b-c3e4-4b36-a801-50aa0b4d4151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4c023b-c3e4-4b36-a801-50aa0b4d4151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941fbb24-4617-4307-b00d-e87eba19fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941fbb24-4617-4307-b00d-e87eba19fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc9d380-7ad3-4baf-a6d7-2dbbd6895110', 'volume_name': 'volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348f58b3-63e8-46ca-bd9d-a421cdcd849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348f58b3-63e8-46ca-bd9d-a421cdcd849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05af1bc1-42f8-44b9-9695-b928b873a23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Volume ebc9d380-7ad3-4baf-a6d7-2dbbd6895110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110', 'volume_size': 1} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2041371622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc9d380-7ad3-4baf-a6d7-2dbbd6895110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3096f8c7bc84cbf8372c244ce68b203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:13Z,use_quota=True,user_id='df3cce948ac64518905cfefa39252c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Creating volume ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:13 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:38:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:13 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 1073741824 Sep 25 11:38:13 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:13 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 1073741824" returned: 0 in 0.668s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:14 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 Sep 25 11:38:14 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:14 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110" returned: 0 in 0.476s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05af1bc1-42f8-44b9-9695-b928b873a23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990265a0-314c-46db-b5d5-0f9a51e1da48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:14 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Volume volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 (ebc9d380-7ad3-4baf-a6d7-2dbbd6895110): created successfully Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990265a0-314c-46db-b5d5-0f9a51e1da48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Flow 'volume_create_manager' (b837fabb-fbf7-49b9-9b80-f28e0052c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9ad4cc4c-2309-4a5e-86d0-a993e606e3a1 tempest-VolumesListAdminTestJSON-1989835186 None] Created volume successfully. Sep 25 11:38:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-8adeba4b-d9b3-4429-8c22-0a521f7d5681 req-6e9fe3a0-a371-4efd-bae5-47df16211dec tempest-ServerActionsTestOtherA-323548451 None] Terminate volume connection completed successfully. Sep 25 11:38:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8adeba4b-d9b3-4429-8c22-0a521f7d5681 req-6e9fe3a0-a371-4efd-bae5-47df16211dec tempest-ServerActionsTestOtherA-323548451 None] Deleting attachment 7fa613e9-c0d2-46e6-ae52-7c9e20aafb80. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Flow 'volume_create_manager' (dc360978-8a2d-41fa-96b1-6a94590977a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b21323-3579-40d5-90b5-4e8c05958b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b21323-3579-40d5-90b5-4e8c05958b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-316040211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32c1b67-30cf-4f21-9904-5fe515eed24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3096f8c7bc84cbf8372c244ce68b203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:16Z,use_quota=True,user_id='df3cce948ac64518905cfefa39252c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c580d0-3e47-4d38-a22b-d492cde3de8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c580d0-3e47-4d38-a22b-d492cde3de8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e110f90-7b9b-40d5-8531-177ad8379ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e110f90-7b9b-40d5-8531-177ad8379ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd32c1b67-30cf-4f21-9904-5fe515eed24f', 'volume_name': 'volume-d32c1b67-30cf-4f21-9904-5fe515eed24f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43df1a23-60fb-4188-9115-6bdcc8a41e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43df1a23-60fb-4188-9115-6bdcc8a41e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1b54e8-acf3-4d1c-a873-1ed6b4059cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:16 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Volume d32c1b67-30cf-4f21-9904-5fe515eed24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d32c1b67-30cf-4f21-9904-5fe515eed24f', 'volume_size': 1} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-316040211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32c1b67-30cf-4f21-9904-5fe515eed24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3096f8c7bc84cbf8372c244ce68b203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:16Z,use_quota=True,user_id='df3cce948ac64518905cfefa39252c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Creating volume d32c1b67-30cf-4f21-9904-5fe515eed24f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:16 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:16 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f 1073741824 Sep 25 11:38:16 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:16 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f 1073741824" returned: 0 in 0.710s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:17 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f Sep 25 11:38:17 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:17 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f" returned: 0 in 0.372s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1b54e8-acf3-4d1c-a873-1ed6b4059cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d32c1b67-30cf-4f21-9904-5fe515eed24f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10577fb3-a733-46ae-a9a2-d43d4dbc14aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:17 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Volume volume-d32c1b67-30cf-4f21-9904-5fe515eed24f (d32c1b67-30cf-4f21-9904-5fe515eed24f): created successfully Sep 25 11:38:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10577fb3-a733-46ae-a9a2-d43d4dbc14aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Flow 'volume_create_manager' (dc360978-8a2d-41fa-96b1-6a94590977a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a01a7ea4-f1a2-48f0-ae69-72addced3adf tempest-VolumesListAdminTestJSON-1989835186 None] Created volume successfully. Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Flow 'volume_create_manager' (5d3ef420-5ead-4779-9e71-1ca5df0d1055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce960958-ddb3-44a6-a551-6cb7394d8546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce960958-ddb3-44a6-a551-6cb7394d8546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1053950661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34dc907-ca11-41ef-8b0b-a31fbf121d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec25713163114c3da5e0da17dd618c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:19Z,use_quota=True,user_id='415457a9bb9d490cb3a98b05acab7c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93f1a3a-d091-43b5-92e2-545056e52336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93f1a3a-d091-43b5-92e2-545056e52336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f68431-baf0-4f70-92ae-d8c9d86d65a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Flow 'volume_create_manager' (51eba4cc-dff9-43ec-a11f-89c03de9b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0acfda-c9be-499a-a0cb-338416328622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0acfda-c9be-499a-a0cb-338416328622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b725911-7398-43c8-bb2f-752a121be8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0e709de0bf4349bb8499e483d9eb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:19Z,use_quota=True,user_id='6108385070534c559d97cce2b6da0e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c533ac2-e78d-4fd1-bc94-5f98583c74d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c533ac2-e78d-4fd1-bc94-5f98583c74d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b17f872-dc2a-4134-bfd8-6107e6831a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b17f872-dc2a-4134-bfd8-6107e6831a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b725911-7398-43c8-bb2f-752a121be8c3', 'volume_name': 'volume-2b725911-7398-43c8-bb2f-752a121be8c3', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edb1ffd-a981-46cc-ac98-2bd724c4bc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edb1ffd-a981-46cc-ac98-2bd724c4bc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049e4acf-a974-4c93-8172-02e2a955f9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Volume 2b725911-7398-43c8-bb2f-752a121be8c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b725911-7398-43c8-bb2f-752a121be8c3', 'volume_size': 1} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b725911-7398-43c8-bb2f-752a121be8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0e709de0bf4349bb8499e483d9eb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:19Z,use_quota=True,user_id='6108385070534c559d97cce2b6da0e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Creating volume 2b725911-7398-43c8-bb2f-752a121be8c3 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:19 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:19 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 1073741824 Sep 25 11:38:19 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:19 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-c2315f3a-0824-4a46-990f-510205dc99de req-06356308-94d3-4221-9f4e-8d981092f7fe tempest-AttachVolumeTestJSON-1559194364 None] Terminate volume connection completed successfully. Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-c2315f3a-0824-4a46-990f-510205dc99de req-06356308-94d3-4221-9f4e-8d981092f7fe tempest-AttachVolumeTestJSON-1559194364 None] Deleting attachment d052b4f9-61e5-4a57-8dd6-15f235db5313. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f68431-baf0-4f70-92ae-d8c9d86d65a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a34dc907-ca11-41ef-8b0b-a31fbf121d57', 'volume_name': 'volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66318453-ddf0-4c2c-8931-a04e7593fa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66318453-ddf0-4c2c-8931-a04e7593fa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f26a007-02f3-4671-bfe5-e32b04580f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Volume a34dc907-ca11-41ef-8b0b-a31fbf121d57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:38:19 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Trying to clone a34dc907-ca11-41ef-8b0b-a31fbf121d57 from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:38:20 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:38:20 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 1073741824" returned: 0 in 0.796s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb56e1f-7b06-4f16-9753-492a1cee6c22]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:20 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 Sep 25 11:38:20 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:20 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD Sep 25 11:38:20 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:20 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3" returned: 0 in 0.340s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049e4acf-a974-4c93-8172-02e2a955f9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b725911-7398-43c8-bb2f-752a121be8c3', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a8e206-68c3-40f4-a353-280573e97564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Volume volume-2b725911-7398-43c8-bb2f-752a121be8c3 (2b725911-7398-43c8-bb2f-752a121be8c3): created successfully Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a8e206-68c3-40f4-a353-280573e97564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Flow 'volume_create_manager' (51eba4cc-dff9-43ec-a11f-89c03de9b877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:21 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ec4a8a49-fc8f-427d-adad-e5778a4f8c3d tempest-VolumesListAdminTestJSON-1894879961 None] Created volume successfully. Sep 25 11:38:21 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 is fetched for user 415457a9bb9d490cb3a98b05acab7c21. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec99511a-ec09-42bf-af38-a6e0e0aa0f2f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:21 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD Sep 25 11:38:21 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:21 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1053950661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34dc907-ca11-41ef-8b0b-a31fbf121d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec25713163114c3da5e0da17dd618c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:19Z,use_quota=True,user_id='415457a9bb9d490cb3a98b05acab7c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Creating volume a34dc907-ca11-41ef-8b0b-a31fbf121d57 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:21 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:21 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 1073741824 Sep 25 11:38:21 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Acquiring lock "cinder-2b725911-7398-43c8-bb2f-752a121be8c3-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Lock "cinder-2b725911-7398-43c8-bb2f-752a121be8c3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Acquiring lock "cinder-quobyte-2b725911-7398-43c8-bb2f-752a121be8c3" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Lock "cinder-quobyte-2b725911-7398-43c8-bb2f-752a121be8c3" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[82159e64-9f71-44ba-ad26-16b34525b065]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "cinder-d32c1b67-30cf-4f21-9904-5fe515eed24f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-d32c1b67-30cf-4f21-9904-5fe515eed24f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "cinder-quobyte-d32c1b67-30cf-4f21-9904-5fe515eed24f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-quobyte-d32c1b67-30cf-4f21-9904-5fe515eed24f" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:22 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 Sep 25 11:38:22 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39afc8a-db67-4275-9a2a-c87258997a83]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:22 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f Sep 25 11:38:22 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:22 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 1073741824" returned: 0 in 0.798s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Flow 'volume_create_manager' (fc3550b5-7d41-466f-98d7-e01c1b301d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071c33ef-b648-4705-9bb9-f4da77dd8d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071c33ef-b648-4705-9bb9-f4da77dd8d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1802008844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba97158-2f69-43e4-9696-082c89ec1440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b365aec46cb471a9fcd8a4cbdf45eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:22Z,use_quota=True,user_id='1e653b14874147c485ae5bb890bcbcaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9ee4de-b646-449b-a0bd-dd5ab22adc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9ee4de-b646-449b-a0bd-dd5ab22adc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4d2791-a445-4628-a977-607a6e47f2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:22 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3" returned: 0 in 0.641s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:22 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 Sep 25 11:38:22 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:22 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3 Sep 25 11:38:22 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:22 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f" returned: 0 in 0.614s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:22 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f Sep 25 11:38:22 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:23 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57" returned: 0 in 0.440s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:23 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b725911-7398-43c8-bb2f-752a121be8c3" returned: 0 in 0.436s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4d2791-a445-4628-a977-607a6e47f2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ba97158-2f69-43e4-9696-082c89ec1440', 'volume_name': 'volume-2ba97158-2f69-43e4-9696-082c89ec1440', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02988f04-988e-4409-8849-08054b774ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02988f04-988e-4409-8849-08054b774ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8107583-d2b8-42fc-974f-3f4faee3235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:23 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Volume 2ba97158-2f69-43e4-9696-082c89ec1440: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ba97158-2f69-43e4-9696-082c89ec1440', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Trying to clone 2ba97158-2f69-43e4-9696-082c89ec1440 from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:23 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:38:23 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Lock "cinder-quobyte-2b725911-7398-43c8-bb2f-752a121be8c3" released by "delete_volume" :: held 1.291s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Attempting download of 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume a34dc907-ca11-41ef-8b0b-a31fbf121d57. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:38:23 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72a828b-5362-4e51-ac36-7dc22a591f8f]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_omnmrghw {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d32c1b67-30cf-4f21-9904-5fe515eed24f" returned: 0 in 0.735s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-quobyte-d32c1b67-30cf-4f21-9904-5fe515eed24f" released by "delete_volume" :: held 1.487s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Created reservations ['59c2ada9-ad00-4f09-9206-12fc54aa2ad9', 'ed4c44b7-72b7-4061-8cb0-1ee096fa2140', '5f6cc88f-51e0-4237-8ea1-2cb30e9f5dba', 'bef7bf32-89ac-41b3-9a53-1ed4f2c1c872'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:23 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_omnmrghw Sep 25 11:38:23 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:23 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.567s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:24 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:38:24 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:38:24 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Created reservations ['88e56089-2b13-460a-9910-4a7bd9548263', '68baa1b2-09ee-420b-840e-595213bf7195', '79d048c6-0042-40be-9ed1-c8c7d91db720', '36322660-2224-45fe-92cb-4d4f31f33c90'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dc217e-7fe2-4771-a79d-4d837132460e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:24 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_omnmrghw" returned: 0 in 0.625s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_omnmrghw {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:24 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:38:24 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:24 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD Sep 25 11:38:24 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:24 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_omnmrghw Sep 25 11:38:24 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.700s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:24 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Deleted volume successfully. Sep 25 11:38:24 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f895517-6aeb-40dd-ae40-a285cf8022c6 tempest-VolumesListAdminTestJSON-1894879961 None] Lock "cinder-2b725911-7398-43c8-bb2f-752a121be8c3-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "cinder-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:25 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD" returned: 0 in 0.971s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 is fetched for user 1e653b14874147c485ae5bb890bcbcaf. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:38:25 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_omnmrghw" returned: 1 in 1.001s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_omnmrghw' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c4adb-f997-49e7-b274-38890b2b2461]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "cinder-quobyte-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:25 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.857s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Deleted volume successfully. Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-quobyte-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110" acquired by "delete_volume" :: waited 0.097s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fc2e4d-fd41-4f43-9365-28226cd1cb99]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e980be50-10a4-4822-8b39-d952ee0c36e2 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-d32c1b67-30cf-4f21-9904-5fe515eed24f-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2662db-0456-4e4e-aa6a-14e35807ee7d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:25 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD Sep 25 11:38:25 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:25 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD Sep 25 11:38:25 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:25 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 Sep 25 11:38:25 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:25 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD" returned: 0 in 0.585s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] 52fc0ca7-cc30-4877-96ee-a5ea6e458871 was qcow2, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:25 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 Sep 25 11:38:25 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:25 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD" returned: 0 in 0.624s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1802008844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba97158-2f69-43e4-9696-082c89ec1440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b365aec46cb471a9fcd8a4cbdf45eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:22Z,use_quota=True,user_id='1e653b14874147c485ae5bb890bcbcaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Creating volume 2ba97158-2f69-43e4-9696-082c89ec1440 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:25 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:38:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:26 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 1073741824 Sep 25 11:38:26 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:26 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110" returned: 0 in 0.755s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:26 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110 Sep 25 11:38:26 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:26 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110" returned: 0 in 0.656s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-quobyte-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110" released by "delete_volume" :: held 1.514s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:26 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Created reservations ['b04b0753-569d-4278-8afe-1f1efc87f483', 'e2f6ee5c-1441-4683-8a1f-abca307eeb9b', 'b6c121fe-382c-41e6-86c8-13b5933dec41', 'b1298398-3391-4b87-9510-ecdc3ccdf0fc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:26 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 1073741824" returned: 0 in 0.986s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:27 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:38:27 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:27 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 Sep 25 11:38:27 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:27 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.546s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:27 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Deleted volume successfully. Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fd345f71-9e21-4a04-b72b-11b68d948774 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-ebc9d380-7ad3-4baf-a6d7-2dbbd6895110-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "cinder-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:27 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440" returned: 0 in 0.702s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "cinder-quobyte-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-quobyte-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8" acquired by "delete_volume" :: waited 0.042s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Attempting download of 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume 2ba97158-2f69-43e4-9696-082c89ec1440. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[82daaa2d-cc7d-48f9-8293-e7e4b84f912b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:28 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a4a2b5-0cd2-4847-9b34-0008888e8493]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_oolp_fru {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:28 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 Sep 25 11:38:28 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:28 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_oolp_fru Sep 25 11:38:28 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:28 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8" returned: 0 in 0.675s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:28 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8 Sep 25 11:38:28 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:28 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_oolp_fru" returned: 0 in 0.681s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_oolp_fru {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:28 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_oolp_fru Sep 25 11:38:28 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:29 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8" returned: 0 in 0.366s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-quobyte-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8" released by "delete_volume" :: held 1.127s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Created reservations ['7c7d9203-5bd7-41ae-9fb0-d09b154f10ed', '7433585d-af70-4aa3-8185-5e39496aaa87', '81452aea-a1ed-45e0-b8ea-a9e1b77a8781', '3f793256-fc44-4c95-92b9-9c9caea952f3'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:29 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_oolp_fru" returned: 1 in 0.512s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_oolp_fru' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b926c5f-043a-4ca6-9e7f-0c8091fe476b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:29 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:38:29 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:29 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD Sep 25 11:38:29 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:29 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57" returned: 0 in 3.992s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_lglb4gdhdevstack@QuobyteHD, size 112.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:38:29 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Converted 112.00 MB image at 28.04 MB/s Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:29 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 1G Sep 25 11:38:29 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:29 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.529s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:29 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Deleted volume successfully. Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD" returned: 0 in 0.615s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] 52fc0ca7-cc30-4877-96ee-a5ea6e458871 was qcow2, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:29 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 Sep 25 11:38:29 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da161be-f51a-4284-b003-3da5253b9085 tempest-VolumesListAdminTestJSON-1989835186 None] Lock "cinder-f1071fb4-211f-4f1e-8a5f-78c2f3136ab8-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:30 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 1G" returned: 0 in 0.527s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Downloaded image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume a34dc907-ca11-41ef-8b0b-a31fbf121d57 successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 for user 415457a9bb9d490cb3a98b05acab7c21 is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Marking volume a34dc907-ca11-41ef-8b0b-a31fbf121d57 as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Copying metadata from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 to a34dc907-ca11-41ef-8b0b-a31fbf121d57. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Creating volume glance metadata for volume a34dc907-ca11-41ef-8b0b-a31fbf121d57 backed by image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f26a007-02f3-4671-bfe5-e32b04580f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99db34dc-44cb-4954-b449-7d602534f064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:30 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Volume volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 (a34dc907-ca11-41ef-8b0b-a31fbf121d57): created successfully Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99db34dc-44cb-4954-b449-7d602534f064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Flow 'volume_create_manager' (5d3ef420-5ead-4779-9e71-1ca5df0d1055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:30 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2d43ef3b-d8f3-4e55-8f93-84a26b028374 tempest-TestShelveInstance-863193198 None] Created volume successfully. Sep 25 11:38:33 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440" returned: 0 in 3.253s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_refyveb_devstack@QuobyteHD, size 112.00 MB, duration 3.25 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:38:33 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Converted 112.00 MB image at 34.42 MB/s Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:33 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 1G Sep 25 11:38:33 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:33 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 1G" returned: 0 in 0.453s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Downloaded image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume 2ba97158-2f69-43e4-9696-082c89ec1440 successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 for user 1e653b14874147c485ae5bb890bcbcaf is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Marking volume 2ba97158-2f69-43e4-9696-082c89ec1440 as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Copying metadata from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 to 2ba97158-2f69-43e4-9696-082c89ec1440. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Creating volume glance metadata for volume 2ba97158-2f69-43e4-9696-082c89ec1440 backed by image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8107583-d2b8-42fc-974f-3f4faee3235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba97158-2f69-43e4-9696-082c89ec1440', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f15918-3dfa-46b0-9ae5-2bbb5469a42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:33 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Volume volume-2ba97158-2f69-43e4-9696-082c89ec1440 (2ba97158-2f69-43e4-9696-082c89ec1440): created successfully Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f15918-3dfa-46b0-9ae5-2bbb5469a42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Flow 'volume_create_manager' (fc3550b5-7d41-466f-98d7-e01c1b301d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:33 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e0d465ee-5acf-4d09-8573-27e52774cd78 tempest-ServerActionsTestOtherA-323548451 None] Created volume successfully. Sep 25 11:38:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-48b76417-4f29-47d9-b4e6-0c2330042246 req-bde876ff-9bfa-4f60-b2b9-dbb6f3acc315 tempest-TestShelveInstance-863193198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-48b76417-4f29-47d9-b4e6-0c2330042246 req-bde876ff-9bfa-4f60-b2b9-dbb6f3acc315 tempest-TestShelveInstance-863193198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-48b76417-4f29-47d9-b4e6-0c2330042246 req-bde876ff-9bfa-4f60-b2b9-dbb6f3acc315 tempest-TestShelveInstance-863193198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-48b76417-4f29-47d9-b4e6-0c2330042246 req-bde876ff-9bfa-4f60-b2b9-dbb6f3acc315 tempest-TestShelveInstance-863193198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b83aebde-2aec-4cc8-82a2-10ed06f57972', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:38:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-48b76417-4f29-47d9-b4e6-0c2330042246 req-bde876ff-9bfa-4f60-b2b9-dbb6f3acc315 tempest-TestShelveInstance-863193198 None] attachment_update completed successfully. Sep 25 11:38:40 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Flow 'volume_create_manager' (b23272b3-2255-4a63-a130-988388680b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54ebbbd-3fac-41cb-b3b2-afb60980befd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54ebbbd-3fac-41cb-b3b2-afb60980befd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1561878467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aca0dd-4c35-422c-9060-2957bab4509f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e7c1d2cb964248bbd40b1f8435c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:40Z,use_quota=True,user_id='eb995c7608ca4bffbc5e2e7696dd9698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872e54e1-9ee5-4dc5-90c5-3f09a633e8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872e54e1-9ee5-4dc5-90c5-3f09a633e8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3ba69f-c0d7-45ae-9fd9-70d31f2ebc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:40 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:38:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3ba69f-c0d7-45ae-9fd9-70d31f2ebc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17aca0dd-4c35-422c-9060-2957bab4509f', 'volume_name': 'volume-17aca0dd-4c35-422c-9060-2957bab4509f', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2de79a-a424-4042-b432-a4c50759feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2de79a-a424-4042-b432-a4c50759feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3cc7d7-87e8-42df-bef7-9b44a370ab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:41 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Volume 17aca0dd-4c35-422c-9060-2957bab4509f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17aca0dd-4c35-422c-9060-2957bab4509f', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:38:41 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Trying to clone 17aca0dd-4c35-422c-9060-2957bab4509f from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:38:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-704eae3b-5984-4ca2-8577-79760994e698 req-a7fbea3d-7b4d-4f39-8f54-0b2006b85a67 tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-704eae3b-5984-4ca2-8577-79760994e698 req-a7fbea3d-7b4d-4f39-8f54-0b2006b85a67 tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-704eae3b-5984-4ca2-8577-79760994e698 req-a7fbea3d-7b4d-4f39-8f54-0b2006b85a67 tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-704eae3b-5984-4ca2-8577-79760994e698 req-a7fbea3d-7b4d-4f39-8f54-0b2006b85a67 tempest-ServerActionsTestOtherA-323548451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-2ba97158-2f69-43e4-9696-082c89ec1440', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68a3a4a1-2b15-4bb8-b46b-adb810e9250b', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:38:42 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-704eae3b-5984-4ca2-8577-79760994e698 req-a7fbea3d-7b4d-4f39-8f54-0b2006b85a67 tempest-ServerActionsTestOtherA-323548451 None] attachment_update completed successfully. Sep 25 11:38:42 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD, size 20.69 MB, duration 1.14 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:38:42 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Image download 20.69 MB at 18.13 MB/s Sep 25 11:38:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[491bc746-db3a-41c3-8aa8-48edaf220269]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:43 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD Sep 25 11:38:43 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:43 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:43 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 is fetched for user eb995c7608ca4bffbc5e2e7696dd9698. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:38:43 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=76,cinder:UPDATE=84,cinder:INSERT=34,cinder:DELETE=7 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:38:43 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=81,cinder:INSERT=24,cinder:UPDATE=73,cinder:DELETE=7 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:38:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87c87ca-93b7-4e0c-8b49-2a42738498d4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:43 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD Sep 25 11:38:43 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:44 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1561878467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aca0dd-4c35-422c-9060-2957bab4509f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e7c1d2cb964248bbd40b1f8435c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:40Z,use_quota=True,user_id='eb995c7608ca4bffbc5e2e7696dd9698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Creating volume 17aca0dd-4c35-422c-9060-2957bab4509f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:44 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:44 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f 1073741824 Sep 25 11:38:44 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:44 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f 1073741824" returned: 0 in 0.721s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:45 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f Sep 25 11:38:45 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:45 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f" returned: 0 in 0.361s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:45 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Attempting download of 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume 17aca0dd-4c35-422c-9060-2957bab4509f. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:38:45 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd6b157-b332-4940-adec-945f6d04889a]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_dndjdz79 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:45 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_dndjdz79 Sep 25 11:38:45 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:46 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_dndjdz79" returned: 0 in 0.546s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_dndjdz79 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:46 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_dndjdz79 Sep 25 11:38:46 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:46 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_dndjdz79" returned: 1 in 0.590s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_dndjdz79' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:38:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd076632-aec7-45f9-8d8b-01019e98e3d8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:47 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD Sep 25 11:38:47 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:47 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD" returned: 0 in 1.152s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:47 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] 52fc0ca7-cc30-4877-96ee-a5ea6e458871 was qcow2, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:38:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:47 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f Sep 25 11:38:47 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:51 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f" returned: 0 in 3.753s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:51 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871__ttnz9ywdevstack@QuobyteHD, size 112.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:38:51 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Converted 112.00 MB image at 29.76 MB/s Sep 25 11:38:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:51 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f 1G Sep 25 11:38:51 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:52 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f 1G" returned: 0 in 1.080s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:52 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Downloaded image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume 17aca0dd-4c35-422c-9060-2957bab4509f successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:38:52 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 for user eb995c7608ca4bffbc5e2e7696dd9698 is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:38:52 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Marking volume 17aca0dd-4c35-422c-9060-2957bab4509f as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:38:52 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Copying metadata from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 to 17aca0dd-4c35-422c-9060-2957bab4509f. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:38:52 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Creating volume glance metadata for volume 17aca0dd-4c35-422c-9060-2957bab4509f backed by image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:38:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3cc7d7-87e8-42df-bef7-9b44a370ab94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17aca0dd-4c35-422c-9060-2957bab4509f', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3219a6fb-7430-4674-a684-cfb7343e160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:53 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Volume volume-17aca0dd-4c35-422c-9060-2957bab4509f (17aca0dd-4c35-422c-9060-2957bab4509f): created successfully Sep 25 11:38:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3219a6fb-7430-4674-a684-cfb7343e160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Flow 'volume_create_manager' (b23272b3-2255-4a63-a130-988388680b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-34d6f1d7-68ea-4f97-9fc5-0a2698ea0ab7 tempest-VolumesImageMetadata-1986760458 None] Created volume successfully. Sep 25 11:38:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Acquiring lock "cinder-17aca0dd-4c35-422c-9060-2957bab4509f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Lock "cinder-17aca0dd-4c35-422c-9060-2957bab4509f-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Acquiring lock "cinder-quobyte-17aca0dd-4c35-422c-9060-2957bab4509f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Lock "cinder-quobyte-17aca0dd-4c35-422c-9060-2957bab4509f" acquired by "delete_volume" :: waited 0.049s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c4841a-c813-49c1-a915-84e0a09205d0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:57 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f Sep 25 11:38:57 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:57 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f" returned: 0 in 1.049s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:57 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f Sep 25 11:38:57 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:58 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-17aca0dd-4c35-422c-9060-2957bab4509f" returned: 0 in 0.850s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Lock "cinder-quobyte-17aca0dd-4c35-422c-9060-2957bab4509f" released by "delete_volume" :: held 2.016s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:58 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Created reservations ['5a0e195f-4fe4-4349-bb9a-633cf1dce76c', '24b3142a-b2ce-425c-8605-2db02bcf3ac4', 'd9a9d898-5919-40f6-95ea-fa4a212f66ce', 'c879d6ad-d1f3-46b7-8487-052bb246e8e2'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:59 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:38:59 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:59 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.587s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:59 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Deleted volume successfully. Sep 25 11:38:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d9e0fa21-a0af-47eb-a1dd-760794408224 tempest-VolumesImageMetadata-1986760458 None] Lock "cinder-17aca0dd-4c35-422c-9060-2957bab4509f-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:39:09 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=14,cinder:SELECT=10,cinder:INSERT=7 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:09 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:INSERT=11,cinder:SELECT=15,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-5e6981e3-2b43-4c40-a9da-2c508135efed req-0920479a-828b-498a-943f-3cca89e94215 tempest-ServerActionsTestOtherA-323548451 None] Terminate volume connection completed successfully. Sep 25 11:39:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5e6981e3-2b43-4c40-a9da-2c508135efed req-0920479a-828b-498a-943f-3cca89e94215 tempest-ServerActionsTestOtherA-323548451 None] Deleting attachment 68a3a4a1-2b15-4bb8-b46b-adb810e9250b. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Flow 'volume_create_manager' (93a1393f-7c87-41fb-9685-7dd8fd2bfa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cf1679-9e4b-4139-a1d0-310d588c1d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cf1679-9e4b-4139-a1d0-310d588c1d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-359080583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4965c78-4359-42fb-acc5-e8ebb74d379d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6b92be894f4973aeffec0d74df73c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:12Z,use_quota=True,user_id='4ab5f08962fd4e71915669448912cb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eda3236-1bfb-4c87-8f86-84315875381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eda3236-1bfb-4c87-8f86-84315875381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff8110b-b277-440e-92e1-874eac147d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff8110b-b277-440e-92e1-874eac147d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4965c78-4359-42fb-acc5-e8ebb74d379d', 'volume_name': 'volume-e4965c78-4359-42fb-acc5-e8ebb74d379d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77eeec92-b1ac-497e-a9b1-135b97b812f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77eeec92-b1ac-497e-a9b1-135b97b812f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190c4ab6-a451-4b72-aa63-ab93c44020a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:12 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Volume e4965c78-4359-42fb-acc5-e8ebb74d379d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4965c78-4359-42fb-acc5-e8ebb74d379d', 'volume_size': 1} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-359080583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4965c78-4359-42fb-acc5-e8ebb74d379d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6b92be894f4973aeffec0d74df73c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:12Z,use_quota=True,user_id='4ab5f08962fd4e71915669448912cb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Creating volume e4965c78-4359-42fb-acc5-e8ebb74d379d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:39:12 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:39:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:12 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d 1073741824 Sep 25 11:39:12 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:13 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d 1073741824" returned: 0 in 0.703s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:13 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d Sep 25 11:39:13 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5e6981e3-2b43-4c40-a9da-2c508135efed req-474544a5-e4bf-4772-8a98-67db4a51b01a tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:14 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d" returned: 0 in 0.442s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5e6981e3-2b43-4c40-a9da-2c508135efed req-474544a5-e4bf-4772-8a98-67db4a51b01a tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.028s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-5e6981e3-2b43-4c40-a9da-2c508135efed req-474544a5-e4bf-4772-8a98-67db4a51b01a tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190c4ab6-a451-4b72-aa63-ab93c44020a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4965c78-4359-42fb-acc5-e8ebb74d379d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aee0d9-9562-4dec-b97b-b626e9899064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:14 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Volume volume-e4965c78-4359-42fb-acc5-e8ebb74d379d (e4965c78-4359-42fb-acc5-e8ebb74d379d): created successfully Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aee0d9-9562-4dec-b97b-b626e9899064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Flow 'volume_create_manager' (93a1393f-7c87-41fb-9685-7dd8fd2bfa31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5f8b971b-cd22-47aa-83d0-791e59fa7122 tempest-AbsoluteLimitsTests-652614419 None] Created volume successfully. Sep 25 11:39:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5e6981e3-2b43-4c40-a9da-2c508135efed req-474544a5-e4bf-4772-8a98-67db4a51b01a tempest-ServerActionsTestOtherA-323548451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-2ba97158-2f69-43e4-9696-082c89ec1440', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ba9f86d-a361-4f17-85f7-f733af1c3f68', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:39:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-5e6981e3-2b43-4c40-a9da-2c508135efed req-474544a5-e4bf-4772-8a98-67db4a51b01a tempest-ServerActionsTestOtherA-323548451 None] attachment_update completed successfully. Sep 25 11:39:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Acquiring lock "cinder-e4965c78-4359-42fb-acc5-e8ebb74d379d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:39:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Lock "cinder-e4965c78-4359-42fb-acc5-e8ebb74d379d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:39:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Acquiring lock "cinder-quobyte-e4965c78-4359-42fb-acc5-e8ebb74d379d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:39:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Lock "cinder-quobyte-e4965c78-4359-42fb-acc5-e8ebb74d379d" acquired by "delete_volume" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:39:15 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ace9f6-3d19-42c5-81f6-ba6891854189]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:39:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:15 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d Sep 25 11:39:15 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:16 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d" returned: 0 in 1.004s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:16 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d Sep 25 11:39:16 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:16 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e4965c78-4359-42fb-acc5-e8ebb74d379d" returned: 0 in 0.432s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Lock "cinder-quobyte-e4965c78-4359-42fb-acc5-e8ebb74d379d" released by "delete_volume" :: held 1.567s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Created reservations ['9ff95f7b-2a79-4c0f-aab5-e0233bef5df1', 'f88dbd43-c35a-4914-b872-8502dd3309ea', 'a28c8543-d8b1-4be2-b337-78636a510dc6', '0826fb80-397d-4964-a8fa-a35d7f9e785a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:17 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:39:17 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:17 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.589s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:17 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:39:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Deleted volume successfully. Sep 25 11:39:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b1ca0ef-2e4a-4590-9b68-fbe8ce8fa487 tempest-AbsoluteLimitsTests-652614419 None] Lock "cinder-e4965c78-4359-42fb-acc5-e8ebb74d379d-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:23 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:39:23 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:23 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.375s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:39:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:39:26 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:27 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=13,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Flow 'volume_create_manager' (3ce2db12-f198-4fd2-b9b2-07235aeb61be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5554b800-3b36-477c-91a0-d581392e12f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5554b800-3b36-477c-91a0-d581392e12f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1497613480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56fa52d9-2beb-4666-a1f9-d456e954c256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcbc6941f784a3682cf1e244814fafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:31Z,use_quota=True,user_id='32e1df48b70b44dbb81d774000fe7a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc93c56-2842-4b16-bee5-62b1da62ab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc93c56-2842-4b16-bee5-62b1da62ab3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b68a6f-0264-4157-ae64-f0630543eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b68a6f-0264-4157-ae64-f0630543eba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56fa52d9-2beb-4666-a1f9-d456e954c256', 'volume_name': 'volume-56fa52d9-2beb-4666-a1f9-d456e954c256', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cc3a85-7231-4674-8ff4-c541fab35eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cc3a85-7231-4674-8ff4-c541fab35eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5603b1a4-f622-4cf5-8820-21c8db18a750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Volume 56fa52d9-2beb-4666-a1f9-d456e954c256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56fa52d9-2beb-4666-a1f9-d456e954c256', 'volume_size': 1} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1497613480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56fa52d9-2beb-4666-a1f9-d456e954c256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcbc6941f784a3682cf1e244814fafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:31Z,use_quota=True,user_id='32e1df48b70b44dbb81d774000fe7a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Creating volume 56fa52d9-2beb-4666-a1f9-d456e954c256 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:39:31 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:39:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:31 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 1073741824 Sep 25 11:39:31 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:32 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 1073741824" returned: 0 in 0.972s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:32 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 Sep 25 11:39:32 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:33 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256" returned: 0 in 0.373s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:39:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5603b1a4-f622-4cf5-8820-21c8db18a750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56fa52d9-2beb-4666-a1f9-d456e954c256', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a1361e-2e8e-452e-8983-d40547176d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:33 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Volume volume-56fa52d9-2beb-4666-a1f9-d456e954c256 (56fa52d9-2beb-4666-a1f9-d456e954c256): created successfully Sep 25 11:39:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a1361e-2e8e-452e-8983-d40547176d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Flow 'volume_create_manager' (3ce2db12-f198-4fd2-b9b2-07235aeb61be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:33 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-33de8f78-e3f4-4353-b65f-c2cd1c344ca5 tempest-VolumesTransfersTest-1517312372 None] Created volume successfully. Sep 25 11:39:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-291d2140-99bc-49c7-8639-3484951e0cd1 tempest-VolumesTransfersTest-1888607193 None] Transfer volume completed successfully. Sep 25 11:39:35 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-55d77ef0-6fac-4d4c-a275-5b4631a537e3 req-b0d5c849-686b-4e9b-bad9-f25b6eafd8f0 tempest-TestShelveInstance-863193198 None] Terminate volume connection completed successfully. Sep 25 11:39:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-55d77ef0-6fac-4d4c-a275-5b4631a537e3 req-b0d5c849-686b-4e9b-bad9-f25b6eafd8f0 tempest-TestShelveInstance-863193198 None] Deleting attachment b83aebde-2aec-4cc8-82a2-10ed06f57972. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:39:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Acquiring lock "cinder-56fa52d9-2beb-4666-a1f9-d456e954c256-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:39:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Lock "cinder-56fa52d9-2beb-4666-a1f9-d456e954c256-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:39:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Acquiring lock "cinder-quobyte-56fa52d9-2beb-4666-a1f9-d456e954c256" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:39:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Lock "cinder-quobyte-56fa52d9-2beb-4666-a1f9-d456e954c256" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:39:36 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[45af7249-b0da-41cb-b1f8-34ae88bf0a15]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:39:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:36 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 Sep 25 11:39:36 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:36 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256" returned: 0 in 0.627s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:37 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256 Sep 25 11:39:37 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:37 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-56fa52d9-2beb-4666-a1f9-d456e954c256" returned: 0 in 0.432s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Lock "cinder-quobyte-56fa52d9-2beb-4666-a1f9-d456e954c256" released by "delete_volume" :: held 1.181s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Created reservations ['753fce03-db75-4945-9d16-f8e2504cfd60', '2faee6df-df99-45a6-ac6f-2ef11b42cf39', '37119e35-17a7-4d9e-9de9-1ed4cb3d508b', 'e8d76b7d-3958-4474-84c0-453d9ac9872f'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:37 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:39:37 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:38 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.573s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:38 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:39:38 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Deleted volume successfully. Sep 25 11:39:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9f263416-0b05-40df-82a1-59ddf2b704c6 tempest-VolumesTransfersTest-1470828533 None] Lock "cinder-56fa52d9-2beb-4666-a1f9-d456e954c256-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-9ad242f1-0f71-4aed-93b9-f6bca35b7303 req-39200b4f-3da1-4d3e-92c2-f1c2201beb66 tempest-TestShelveInstance-863193198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-9ad242f1-0f71-4aed-93b9-f6bca35b7303 req-39200b4f-3da1-4d3e-92c2-f1c2201beb66 tempest-TestShelveInstance-863193198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-9ad242f1-0f71-4aed-93b9-f6bca35b7303 req-39200b4f-3da1-4d3e-92c2-f1c2201beb66 tempest-TestShelveInstance-863193198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.078s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-9ad242f1-0f71-4aed-93b9-f6bca35b7303 req-39200b4f-3da1-4d3e-92c2-f1c2201beb66 tempest-TestShelveInstance-863193198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14a1b761-70e2-4cb7-aa46-8b58e2ac8eb8', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Flow 'volume_create_manager' (385ba21a-3b99-4e65-8d57-2b6a50b7b03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f133a9-bbbb-4be7-9a34-3398bfb7851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:39 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-9ad242f1-0f71-4aed-93b9-f6bca35b7303 req-39200b4f-3da1-4d3e-92c2-f1c2201beb66 tempest-TestShelveInstance-863193198 None] attachment_update completed successfully. Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f133a9-bbbb-4be7-9a34-3398bfb7851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-509288477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aafad45-01e7-4bbd-89ff-d819dcb2bbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcbc6941f784a3682cf1e244814fafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:40Z,use_quota=True,user_id='32e1df48b70b44dbb81d774000fe7a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2066097a-71a2-4bb7-b629-5f5d85344330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2066097a-71a2-4bb7-b629-5f5d85344330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d99053-2de5-4b64-875c-a78becbaa757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d99053-2de5-4b64-875c-a78becbaa757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aafad45-01e7-4bbd-89ff-d819dcb2bbf1', 'volume_name': 'volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfb8a60-f310-426b-9ba3-bcf0b9a567c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfb8a60-f310-426b-9ba3-bcf0b9a567c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ed9f60-cce0-4da2-a96a-2fe98a939cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:39 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Volume 8aafad45-01e7-4bbd-89ff-d819dcb2bbf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1', 'volume_size': 1} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-509288477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aafad45-01e7-4bbd-89ff-d819dcb2bbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcbc6941f784a3682cf1e244814fafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:40Z,use_quota=True,user_id='32e1df48b70b44dbb81d774000fe7a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Creating volume 8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:39:39 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:39:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:39 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 1073741824 Sep 25 11:39:39 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:40 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 1073741824" returned: 0 in 0.831s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:40 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 Sep 25 11:39:40 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:41 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1" returned: 0 in 0.418s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:39:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ed9f60-cce0-4da2-a96a-2fe98a939cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a388a0-81c9-4aed-8d75-5ea3685005f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:41 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Volume volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 (8aafad45-01e7-4bbd-89ff-d819dcb2bbf1): created successfully Sep 25 11:39:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a388a0-81c9-4aed-8d75-5ea3685005f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Flow 'volume_create_manager' (385ba21a-3b99-4e65-8d57-2b6a50b7b03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:41 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e58cab2e-4cbe-4277-b301-f734502701c7 tempest-VolumesTransfersTest-1517312372 None] Created volume successfully. Sep 25 11:39:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Acquiring lock "cinder-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:39:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Lock "cinder-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:39:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Acquiring lock "cinder-quobyte-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:39:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Lock "cinder-quobyte-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1" acquired by "delete_volume" :: waited 0.036s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:39:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff86ffcb-2657-4433-8f02-e4ae6ef2145c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:39:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:42 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 Sep 25 11:39:42 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:43 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1" returned: 0 in 0.466s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:43 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1 Sep 25 11:39:43 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:43 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1" returned: 0 in 0.332s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Lock "cinder-quobyte-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1" released by "delete_volume" :: held 0.885s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Created reservations ['b4292a4c-5399-4a4a-8fd0-3e274309d5b1', '9d829de4-3f14-4948-adf7-76aa582b3fc8', 'abe713d8-9829-4bc0-877e-ecd88b54c872', '033a16f9-7647-4f11-b18d-9b55be362c72'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:43 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:39:43 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:44 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 1.007s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:44 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:39:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Deleted volume successfully. Sep 25 11:39:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ee5d8450-fa10-4f0e-9b27-54311cf38f20 tempest-VolumesTransfersTest-1470828533 None] Lock "cinder-8aafad45-01e7-4bbd-89ff-d819dcb2bbf1-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:39:53 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:54 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=22,cinder:SELECT=20,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Flow 'volume_create_manager' (4932e044-626c-4be4-803f-4117fa8da820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b106baf-6790-4308-861e-d54443f853f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b106baf-6790-4308-861e-d54443f853f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2112266499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f96c045-a572-4e7c-ab4a-a583e914feef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd529db4775c41e0ae267ce84f83158c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:55Z,use_quota=True,user_id='978a1adda12844d28007432cadabf5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c0fe56-3599-4732-aa3c-3d0bff44e0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c0fe56-3599-4732-aa3c-3d0bff44e0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9f08ff-39b7-4fc0-b6c5-50614270cb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9f08ff-39b7-4fc0-b6c5-50614270cb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f96c045-a572-4e7c-ab4a-a583e914feef', 'volume_name': 'volume-1f96c045-a572-4e7c-ab4a-a583e914feef', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cb7b24-f65f-41d4-8b7a-f151435cdb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cb7b24-f65f-41d4-8b7a-f151435cdb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed50a42a-e009-4f33-b509-b61e92581b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:55 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Volume 1f96c045-a572-4e7c-ab4a-a583e914feef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f96c045-a572-4e7c-ab4a-a583e914feef', 'volume_size': 1} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2112266499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f96c045-a572-4e7c-ab4a-a583e914feef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd529db4775c41e0ae267ce84f83158c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:55Z,use_quota=True,user_id='978a1adda12844d28007432cadabf5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Creating volume 1f96c045-a572-4e7c-ab4a-a583e914feef {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:39:55 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:39:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:55 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef 1073741824 Sep 25 11:39:55 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:56 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef 1073741824" returned: 0 in 0.603s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:56 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef Sep 25 11:39:56 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:56 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef" returned: 0 in 0.307s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed50a42a-e009-4f33-b509-b61e92581b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f96c045-a572-4e7c-ab4a-a583e914feef', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92d2f14-38af-4a51-804a-85451f7df2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:56 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Volume volume-1f96c045-a572-4e7c-ab4a-a583e914feef (1f96c045-a572-4e7c-ab4a-a583e914feef): created successfully Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92d2f14-38af-4a51-804a-85451f7df2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Flow 'volume_create_manager' (4932e044-626c-4be4-803f-4117fa8da820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-05c7bbc4-6552-4893-9807-8ee3009b6493 tempest-AttachVolumeTestJSON-1559194364 None] Created volume successfully. Sep 25 11:39:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-0d144dc9-7d8f-484b-94b2-75a4f222e95f req-033bc238-72ee-4f62-aecd-2b022c5f8063 tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-0d144dc9-7d8f-484b-94b2-75a4f222e95f req-033bc238-72ee-4f62-aecd-2b022c5f8063 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-0d144dc9-7d8f-484b-94b2-75a4f222e95f req-033bc238-72ee-4f62-aecd-2b022c5f8063 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-0d144dc9-7d8f-484b-94b2-75a4f222e95f req-033bc238-72ee-4f62-aecd-2b022c5f8063 tempest-AttachVolumeTestJSON-1559194364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-1f96c045-a572-4e7c-ab4a-a583e914feef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c82a6595-64c3-454d-9b07-7e6bcdbe96ad', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:39:59 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-0d144dc9-7d8f-484b-94b2-75a4f222e95f req-033bc238-72ee-4f62-aecd-2b022c5f8063 tempest-AttachVolumeTestJSON-1559194364 None] attachment_update completed successfully. Sep 25 11:40:01 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Flow 'volume_create_manager' (1c5a68de-fd4b-454e-81a0-0ab090e3412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd67055-d4dd-4a10-90f7-9c5cf7bd3637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd67055-d4dd-4a10-90f7-9c5cf7bd3637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-521386510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b351d3-ebf7-4ea5-874f-2c46a6d81349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd529db4775c41e0ae267ce84f83158c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:02Z,use_quota=True,user_id='978a1adda12844d28007432cadabf5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07775242-6a29-492d-a734-1414b2b128f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07775242-6a29-492d-a734-1414b2b128f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf820178-bd74-47a7-8055-8321e434f525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf820178-bd74-47a7-8055-8321e434f525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b351d3-ebf7-4ea5-874f-2c46a6d81349', 'volume_name': 'volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2170ccc8-cf02-4ebf-8ed0-35f826c152d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2170ccc8-cf02-4ebf-8ed0-35f826c152d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21268dc4-eda5-455d-8798-048e31308c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:02 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Volume 92b351d3-ebf7-4ea5-874f-2c46a6d81349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349', 'volume_size': 1} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-521386510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b351d3-ebf7-4ea5-874f-2c46a6d81349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd529db4775c41e0ae267ce84f83158c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:02Z,use_quota=True,user_id='978a1adda12844d28007432cadabf5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Creating volume 92b351d3-ebf7-4ea5-874f-2c46a6d81349 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:02 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:02 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 1073741824 Sep 25 11:40:02 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:02 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 1073741824" returned: 0 in 0.602s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:02 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 Sep 25 11:40:02 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:03 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349" returned: 0 in 0.342s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:40:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21268dc4-eda5-455d-8798-048e31308c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f6b5d1-050e-40bd-a993-9d605d06f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:03 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Volume volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 (92b351d3-ebf7-4ea5-874f-2c46a6d81349): created successfully Sep 25 11:40:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f6b5d1-050e-40bd-a993-9d605d06f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Flow 'volume_create_manager' (1c5a68de-fd4b-454e-81a0-0ab090e3412f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:03 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ce781b6b-eb19-4624-a2dc-0da85dba851e tempest-AttachVolumeTestJSON-1559194364 None] Created volume successfully. Sep 25 11:40:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-207c4fcc-3b00-4c21-a7a9-d19634ab099d req-c11c9ff3-8f55-48d7-8521-cbe53eb9c14a tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-207c4fcc-3b00-4c21-a7a9-d19634ab099d req-c11c9ff3-8f55-48d7-8521-cbe53eb9c14a tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-207c4fcc-3b00-4c21-a7a9-d19634ab099d req-c11c9ff3-8f55-48d7-8521-cbe53eb9c14a tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-207c4fcc-3b00-4c21-a7a9-d19634ab099d req-c11c9ff3-8f55-48d7-8521-cbe53eb9c14a tempest-AttachVolumeTestJSON-1559194364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba211b9e-4893-4a92-88ea-4f7550707c09', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:40:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-207c4fcc-3b00-4c21-a7a9-d19634ab099d req-c11c9ff3-8f55-48d7-8521-cbe53eb9c14a tempest-AttachVolumeTestJSON-1559194364 None] attachment_update completed successfully. Sep 25 11:40:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-9123547c-8e94-411d-9158-35e4a6d58496 req-b6955ab0-5a13-49b9-83cd-08ce71e047cb tempest-AttachVolumeTestJSON-1559194364 None] Terminate volume connection completed successfully. Sep 25 11:40:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-9123547c-8e94-411d-9158-35e4a6d58496 req-b6955ab0-5a13-49b9-83cd-08ce71e047cb tempest-AttachVolumeTestJSON-1559194364 None] Deleting attachment c82a6595-64c3-454d-9b07-7e6bcdbe96ad. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:40:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-316aecd0-f2c8-4b12-907f-5d26916d43ba tempest-ServerActionsTestOtherA-323548451 None] Terminate volume connection completed successfully. Sep 25 11:40:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-316aecd0-f2c8-4b12-907f-5d26916d43ba tempest-ServerActionsTestOtherA-323548451 None] Deleting attachment 8ba9f86d-a361-4f17-85f7-f733af1c3f68. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:40:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "cinder-2ba97158-2f69-43e4-9696-082c89ec1440-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Lock "cinder-2ba97158-2f69-43e4-9696-082c89ec1440-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "cinder-quobyte-2ba97158-2f69-43e4-9696-082c89ec1440" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:12 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-a643e12a-b0e0-485b-90c8-ba5217e0de78 req-d49e7ff8-ff4b-4060-874b-df7abe9e2833 tempest-AttachVolumeTestJSON-1559194364 None] Terminate volume connection completed successfully. Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-a643e12a-b0e0-485b-90c8-ba5217e0de78 req-d49e7ff8-ff4b-4060-874b-df7abe9e2833 tempest-AttachVolumeTestJSON-1559194364 None] Deleting attachment ba211b9e-4893-4a92-88ea-4f7550707c09. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Lock "cinder-quobyte-2ba97158-2f69-43e4-9696-082c89ec1440" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccf6fbe-95a5-4f56-9575-e2e63ed25b0c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:12 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 Sep 25 11:40:12 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (28544b8e-7825-438e-8d20-5d04b41ec779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c0b2ac-8d40-41aa-9682-68550d28b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c0b2ac-8d40-41aa-9682-68550d28b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-503014396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4838228-17d1-4789-abef-b54d5d4a52a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d05a14b87d4c14b5225f9284a8c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:12Z,use_quota=True,user_id='c8a826d21343496cb8aae2593fba23d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7840b4-52ef-409f-a6c3-2a7ed3d75d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7840b4-52ef-409f-a6c3-2a7ed3d75d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a332ba3-a15a-4d7d-887f-bdafdb989e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a332ba3-a15a-4d7d-887f-bdafdb989e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4838228-17d1-4789-abef-b54d5d4a52a2', 'volume_name': 'volume-d4838228-17d1-4789-abef-b54d5d4a52a2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c487a80-c506-4ad8-8327-8f0eea380c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c487a80-c506-4ad8-8327-8f0eea380c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56d6b2f-52e2-4774-8373-39f48d4f1c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:12 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Volume d4838228-17d1-4789-abef-b54d5d4a52a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4838228-17d1-4789-abef-b54d5d4a52a2', 'volume_size': 1} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-503014396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4838228-17d1-4789-abef-b54d5d4a52a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d05a14b87d4c14b5225f9284a8c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:12Z,use_quota=True,user_id='c8a826d21343496cb8aae2593fba23d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Creating volume d4838228-17d1-4789-abef-b54d5d4a52a2 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:12 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:40:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:12 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 1073741824 Sep 25 11:40:12 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:13 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440" returned: 0 in 0.894s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:13 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440 Sep 25 11:40:13 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:13 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2ba97158-2f69-43e4-9696-082c89ec1440" returned: 0 in 0.502s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Lock "cinder-quobyte-2ba97158-2f69-43e4-9696-082c89ec1440" released by "delete_volume" :: held 1.488s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:13 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 1073741824" returned: 0 in 0.769s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG cinder.quota [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Created reservations ['f994c9cb-228f-4175-9f5f-d90fa79f2a04', '55d8189b-9d18-4340-a9bb-595d5750f302', 'ec97348e-72ce-450a-b403-6c64dfc08a72', '3f98c595-a606-4a37-96bc-bb224c525661'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:13 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 Sep 25 11:40:13 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:13 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:13 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "cinder-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Lock "cinder-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:14 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:14 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2" returned: 0 in 0.793s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.635s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.manager [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Deleted volume successfully. Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56d6b2f-52e2-4774-8373-39f48d4f1c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4838228-17d1-4789-abef-b54d5d4a52a2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce89c4b1-89af-449f-8a4d-e19a083ddc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-35886c11-ee1c-40f2-8735-01985ae7b8f9 req-c1f23335-834f-475d-8055-8ac49c8ddb4b tempest-ServerActionsTestOtherA-323548451 None] Lock "cinder-2ba97158-2f69-43e4-9696-082c89ec1440-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "cinder-quobyte-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:14 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Volume volume-d4838228-17d1-4789-abef-b54d5d4a52a2 (d4838228-17d1-4789-abef-b54d5d4a52a2): created successfully Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce89c4b1-89af-449f-8a4d-e19a083ddc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (28544b8e-7825-438e-8d20-5d04b41ec779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-48007557-9579-4aa8-8c4e-a6caef691837 tempest-VolumesSnapshotTestJSON-830189143 None] Created volume successfully. Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Lock "cinder-quobyte-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821" acquired by "delete_volume" :: waited 0.124s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e6cb4-41fb-497b-aa27-68ca0d2983c2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:15 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 Sep 25 11:40:15 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:15 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821" returned: 0 in 0.590s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:15 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821 Sep 25 11:40:15 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:15 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821" returned: 0 in 0.419s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Lock "cinder-quobyte-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821" released by "delete_volume" :: held 1.113s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Created reservations ['ef9f4942-832b-44b6-b555-b54106a8afe6', '9d0e214f-33ea-468f-9b72-428e9ead1302', '3d98a791-d4bc-4537-9110-def4886c3176', '8069af3c-72f2-4e9d-8990-c6e6753121cd'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:16 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:16 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Creating offline snapshot 23b556c0-89fa-482a-a58a-9232a010c2f1 of volume d4838228-17d1-4789-abef-b54d5d4a52a2 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cada6a-3792-4bb2-89d2-35bc63e9df86]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:16 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.500s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Deleted volume successfully. Sep 25 11:40:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d431efcb-a1b0-4313-a5f1-b3d6be5813fb tempest-ServerActionsTestOtherA-323548451 None] Lock "cinder-632ec3f3-23c8-4cb1-bfe2-9b2cf99a4821-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:16 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 Sep 25 11:40:16 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:17 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2" returned: 0 in 0.467s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:17 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 1G Sep 25 11:40:17 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:17 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 1G" returned: 0 in 0.715s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4838228-17d1-4789-abef-b54d5d4a52a2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:17 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4838228-17d1-4789-abef-b54d5d4a52a2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 Sep 25 11:40:17 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:18 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4838228-17d1-4789-abef-b54d5d4a52a2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1" returned: 0 in 0.606s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:18 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 is being set with open permissions: ugo+rw Sep 25 11:40:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:18 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 Sep 25 11:40:18 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:18 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:18 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.info Sep 25 11:40:18 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:19 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.info" returned: 0 in 0.394s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:19 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.info is being set with open permissions: ugo+rw Sep 25 11:40:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:19 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.info Sep 25 11:40:19 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:19 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.info" returned: 0 in 0.360s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.067s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:19 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f7be4c0f-307b-48f7-954e-6c57b0f4c3ab tempest-VolumesSnapshotTestJSON-830189143 None] Create snapshot completed successfully Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-23b556c0-89fa-482a-a58a-9232a010c2f1-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-23b556c0-89fa-482a-a58a-9232a010c2f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-d4838228-17d1-4789-abef-b54d5d4a52a2" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-d4838228-17d1-4789-abef-b54d5d4a52a2" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-23b556c0-89fa-482a-a58a-9232a010c2f1" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-23b556c0-89fa-482a-a58a-9232a010c2f1" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Deleting offline snapshot 23b556c0-89fa-482a-a58a-9232a010c2f1 of volume d4838228-17d1-4789-abef-b54d5d4a52a2 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] snapshot_file for this snap is: volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d21255-b42c-4bf3-8694-215b6a808daf]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:21 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 Sep 25 11:40:21 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:21 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1" returned: 0 in 0.545s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4838228-17d1-4789-abef-b54d5d4a52a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffffb3c-878b-440d-a53f-6edfca01e7fe]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:22 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 Sep 25 11:40:22 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "cinder-92b351d3-ebf7-4ea5-874f-2c46a6d81349-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-92b351d3-ebf7-4ea5-874f-2c46a6d81349-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "cinder-quobyte-92b351d3-ebf7-4ea5-874f-2c46a6d81349" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-quobyte-92b351d3-ebf7-4ea5-874f-2c46a6d81349" acquired by "delete_volume" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81b0900-9390-455b-83d1-adf63d750291]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:22 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 Sep 25 11:40:22 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:22 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2" returned: 0 in 0.509s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:22 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 Sep 25 11:40:22 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:22 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349" returned: 0 in 0.436s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:22 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349 Sep 25 11:40:22 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:22 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1" returned: 0 in 0.422s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:22 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1 Sep 25 11:40:22 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:22 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-92b351d3-ebf7-4ea5-874f-2c46a6d81349" returned: 0 in 0.299s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-quobyte-92b351d3-ebf7-4ea5-874f-2c46a6d81349" released by "delete_volume" :: held 0.799s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Created reservations ['7830c602-8755-420e-8bb9-2e5de1057a74', '10bb671e-fe94-4d9e-ad3f-90b78b05f60c', 'f4a55097-cc2a-4adc-b805-a43919a6f4fc', '9fa551a4-6778-4c84-9c4d-c4a45a233e4b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:23 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2.23b556c0-89fa-482a-a58a-9232a010c2f1" returned: 0 in 0.383s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:23 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:23 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-23b556c0-89fa-482a-a58a-9232a010c2f1" released by "_delete_snapshot" :: held 2.111s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:23 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-d4838228-17d1-4789-abef-b54d5d4a52a2" released by "delete_snapshot" :: held 2.168s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:23 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "cinder-1f96c045-a572-4e7c-ab4a-a583e914feef-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-1f96c045-a572-4e7c-ab4a-a583e914feef-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "cinder-quobyte-1f96c045-a572-4e7c-ab4a-a583e914feef" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-quobyte-1f96c045-a572-4e7c-ab4a-a583e914feef" acquired by "delete_volume" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Created reservations ['c4423bdc-3c3b-4bc3-9b16-d0e5dbc17c02', '03de5efa-7f77-453a-98ce-ab9ceaeba7a7', 'c0bf0550-f399-4d3f-931d-edac7cf22db4', '0ce9b86b-d681-45cb-a848-fb2d0d486978'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdacabdc-dc99-44d5-b246-9fff6a034354]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:23 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.429s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:40:23 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Delete snapshot completed successfully. Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fb0e69c-1ccf-4f2a-9779-0cf1e5b70497 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-23b556c0-89fa-482a-a58a-9232a010c2f1-delete_snapshot" released by "delete_snapshot" :: held 2.555s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:23 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef Sep 25 11:40:23 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:23 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.431s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:23 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Deleted volume successfully. Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-edb496eb-61da-4e57-bea1-33548a6056db tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-92b351d3-ebf7-4ea5-874f-2c46a6d81349-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:23 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef" returned: 0 in 0.428s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:24 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef Sep 25 11:40:24 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:24 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f96c045-a572-4e7c-ab4a-a583e914feef" returned: 0 in 0.339s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-quobyte-1f96c045-a572-4e7c-ab4a-a583e914feef" released by "delete_volume" :: held 0.842s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Created reservations ['8776c073-adc7-4b34-852a-1025223f93e7', '49ade30f-2534-46aa-84eb-eef269101905', 'c70f6005-90fc-47ad-b6a7-2dafb2062fae', 'e6739198-f75f-4310-bb71-bbcb2137fc18'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:24 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:24 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "cinder-29032c9a-0440-4428-acd8-75b560492995-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-29032c9a-0440-4428-acd8-75b560492995-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "cinder-quobyte-29032c9a-0440-4428-acd8-75b560492995" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-quobyte-29032c9a-0440-4428-acd8-75b560492995" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f6602-4d81-4e50-b8c8-4781924708e4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:25 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.507s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Deleted volume successfully. Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f5c5fa6-9c3d-41c5-a658-d3fe27f0f617 tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-1f96c045-a572-4e7c-ab4a-a583e914feef-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:25 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 Sep 25 11:40:25 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (8d6633a1-4f4a-4a3b-a48d-bee6610c93e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94153fc-0911-4651-80ba-e7e57f0bba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94153fc-0911-4651-80ba-e7e57f0bba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-672592339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d05a14b87d4c14b5225f9284a8c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:25Z,use_quota=True,user_id='c8a826d21343496cb8aae2593fba23d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe306e67-fba1-4258-bcbc-bb0d5818de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe306e67-fba1-4258-bcbc-bb0d5818de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986714aa-37bb-4001-baf3-e46f5854e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986714aa-37bb-4001-baf3-e46f5854e974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4', 'volume_name': 'volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcecd91-e413-4156-8206-57199899fb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcecd91-e413-4156-8206-57199899fb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a618f99f-ff45-4a8f-97b9-e48fbbf41d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:25 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Volume b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4', 'volume_size': 1} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-672592339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d05a14b87d4c14b5225f9284a8c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:25Z,use_quota=True,user_id='c8a826d21343496cb8aae2593fba23d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Creating volume b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:25 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:25 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 1073741824 Sep 25 11:40:25 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:25 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995" returned: 0 in 0.680s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:25 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995 Sep 25 11:40:25 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:26 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-29032c9a-0440-4428-acd8-75b560492995" returned: 0 in 0.472s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-quobyte-29032c9a-0440-4428-acd8-75b560492995" released by "delete_volume" :: held 1.227s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Created reservations ['a5d8fec3-974f-4b9a-87ba-652fac5eadc6', 'd4971783-5da6-4bd0-897a-96e5c92aa5d0', '8dc79dbf-f34e-4c61-856a-c9c43ca36f88', '04ec01e1-67ac-4303-8c00-c37ba7b9b0c2'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:26 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 1073741824" returned: 0 in 0.716s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:26 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 Sep 25 11:40:26 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:26 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:26 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:26 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" returned: 0 in 0.404s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a618f99f-ff45-4a8f-97b9-e48fbbf41d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b501965f-cae4-4fac-b8a1-2f615d66742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:26 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.372s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Deleted volume successfully. Sep 25 11:40:26 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Volume volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 (b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4): created successfully Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b501965f-cae4-4fac-b8a1-2f615d66742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (8d6633a1-4f4a-4a3b-a48d-bee6610c93e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2f0ca0c5-8ad6-487a-8932-fc773eb34dfe tempest-AttachVolumeTestJSON-1559194364 None] Lock "cinder-29032c9a-0440-4428-acd8-75b560492995-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-dc36a1dc-618a-4151-9fb1-99262581b3a5 tempest-VolumesSnapshotTestJSON-830189143 None] Created volume successfully. Sep 25 11:40:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Creating offline snapshot 922f33f2-eb8c-4d62-b51d-fad6bf275d0f of volume b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:40:28 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9b207d-a102-47c5-9aed-9c18b117aefc]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:28 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 Sep 25 11:40:28 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:28 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" returned: 0 in 0.633s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:28 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f 1G Sep 25 11:40:28 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:29 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-68b1f142-d28f-4332-9a89-ec9244545b4b tempest-TestShelveInstance-863193198 None] Terminate volume connection completed successfully. Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-68b1f142-d28f-4332-9a89-ec9244545b4b tempest-TestShelveInstance-863193198 None] Deleting attachment 14a1b761-70e2-4cb7-aa46-8b58e2ac8eb8. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f 1G" returned: 0 in 0.697s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:29 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f Sep 25 11:40:29 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Acquiring lock "cinder-a34dc907-ca11-41ef-8b0b-a31fbf121d57-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Lock "cinder-a34dc907-ca11-41ef-8b0b-a31fbf121d57-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Acquiring lock "cinder-quobyte-a34dc907-ca11-41ef-8b0b-a31fbf121d57" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Lock "cinder-quobyte-a34dc907-ca11-41ef-8b0b-a31fbf121d57" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7acb7fc-74c6-4733-b6a0-0960fca0703d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:30 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f" returned: 0 in 0.547s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:30 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f is being set with open permissions: ugo+rw Sep 25 11:40:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:30 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 Sep 25 11:40:30 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:30 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f Sep 25 11:40:30 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:30 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f" returned: 0 in 0.555s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:30 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57" returned: 0 in 0.809s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:30 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57 Sep 25 11:40:30 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:30 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.info Sep 25 11:40:30 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:31 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34dc907-ca11-41ef-8b0b-a31fbf121d57" returned: 0 in 0.343s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Lock "cinder-quobyte-a34dc907-ca11-41ef-8b0b-a31fbf121d57" released by "delete_volume" :: held 1.229s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG cinder.quota [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Created reservations ['e87ac4d1-fad8-44e3-bfd3-1787d941cabe', '39de3153-7599-4047-83ba-f1197b069e3f', '9d2bde3c-4dc0-4326-93c7-aef72bdd1189', '61ae14fd-cc61-4996-94cf-bc5228a04b4c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:31 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.info" returned: 0 in 0.497s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:31 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.info is being set with open permissions: ugo+rw Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:31 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.info Sep 25 11:40:31 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:31 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:31 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:31 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.info" returned: 0 in 0.339s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.521s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ae51188f-c0d5-4c05-826f-85f68956aedf tempest-VolumesSnapshotTestJSON-830189143 None] Create snapshot completed successfully Sep 25 11:40:31 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.373s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG cinder.manager [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Deleted volume successfully. Sep 25 11:40:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-db088e75-edf3-4360-9fed-3e6cb4b87ea4 req-4e5cffeb-715e-4cdb-8337-4f1093f26632 tempest-TestShelveInstance-863193198 None] Lock "cinder-a34dc907-ca11-41ef-8b0b-a31fbf121d57-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (38199dae-86b2-4c07-af5b-ce2414835f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd690269-3a2f-4f51-a801-2a02174023ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd690269-3a2f-4f51-a801-2a02174023ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-434948691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859fa3c8-f237-4ccf-9f43-0718e7cc9e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d05a14b87d4c14b5225f9284a8c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=922f33f2-eb8c-4d62-b51d-fad6bf275d0f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:33Z,use_quota=True,user_id='c8a826d21343496cb8aae2593fba23d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880438cc-f83a-43d8-b7d2-082d5a90c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880438cc-f83a-43d8-b7d2-082d5a90c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c10f611-8c8d-4231-8464-7a17a457cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c10f611-8c8d-4231-8464-7a17a457cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '859fa3c8-f237-4ccf-9f43-0718e7cc9e92', 'volume_name': 'volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92', 'volume_size': 2, 'snapshot_id': '922f33f2-eb8c-4d62-b51d-fad6bf275d0f'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b820f529-1fa4-437f-b571-01d4d665c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b820f529-1fa4-437f-b571-01d4d665c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e467ec39-3bb8-4898-bb07-03d89cc44811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:33 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Volume 859fa3c8-f237-4ccf-9f43-0718e7cc9e92: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92', 'volume_size': 2, 'snapshot_id': '922f33f2-eb8c-4d62-b51d-fad6bf275d0f'} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-922f33f2-eb8c-4d62-b51d-fad6bf275d0f-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-922f33f2-eb8c-4d62-b51d-fad6bf275d0f-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Creating volume 859fa3c8-f237-4ccf-9f43-0718e7cc9e92 from snapshot 922f33f2-eb8c-4d62-b51d-fad6bf275d0f {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] snapshot: 922f33f2-eb8c-4d62-b51d-fad6bf275d0f, volume: 859fa3c8-f237-4ccf-9f43-0718e7cc9e92, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f3275e-cce4-4680-bc20-281d9ce19516]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:33 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f Sep 25 11:40:33 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:34 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f" returned: 0 in 0.532s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d4a891-6b1f-4849-b879-3e8a8b5bcbfd]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:34 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 Sep 25 11:40:34 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:34 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" returned: 0 in 0.706s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:40:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:34 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 Sep 25 11:40:34 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1aeb30c3-b261-4779-b917-2777cca03a9f tempest-GroupSnapshotsTest-1613358976 None] Group tempest-GroupSnapshotsTest-Group-1281462347: creating Sep 25 11:40:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1aeb30c3-b261-4779-b917-2777cca03a9f tempest-GroupSnapshotsTest-1613358976 None] Group tempest-GroupSnapshotsTest-Group-1281462347: created successfully Sep 25 11:40:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1aeb30c3-b261-4779-b917-2777cca03a9f tempest-GroupSnapshotsTest-1613358976 None] Create group completed successfully. Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Flow 'volume_create_manager' (b2edbcf7-2c44-4e8f-8367-004f767dd796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c8c885-4164-4714-a603-06395698a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c8c885-4164-4714-a603-06395698a235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1644638493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c430e74-be5b-41dc-9ba9-0ec82cbdd7c8,host='devstack@QuobyteHD#QuobyteHD',id=147165dc-1ea3-450d-a78d-18d8de24b11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c00a00ea46bbaa17f7bff9209816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:40Z,use_quota=True,user_id='e001582fc82e43fc967440cd174ada76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(692b3155-836f-4b3f-92a6-30dfbcdc78d1),volume_type_id=692b3155-836f-4b3f-92a6-30dfbcdc78d1)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e32b358-64b6-4d5c-a533-19caba07d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e32b358-64b6-4d5c-a533-19caba07d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0188b6c-a70c-4a0b-8096-79811435593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0188b6c-a70c-4a0b-8096-79811435593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '147165dc-1ea3-450d-a78d-18d8de24b11b', 'volume_name': 'volume-147165dc-1ea3-450d-a78d-18d8de24b11b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766dae86-3977-4b7d-bb8f-5634d14624d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766dae86-3977-4b7d-bb8f-5634d14624d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7bd39a-2b96-4959-9196-f06fe4fec58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:40 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Volume 147165dc-1ea3-450d-a78d-18d8de24b11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-147165dc-1ea3-450d-a78d-18d8de24b11b', 'volume_size': 1} Sep 25 11:40:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:44 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" returned: 0 in 9.848s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:44 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4, size 1024.00 MB, duration 9.85 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:40:44 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Converted 1024.00 MB image at 103.97 MB/s Sep 25 11:40:44 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 is being set with open permissions: ugo+rw Sep 25 11:40:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:44 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 Sep 25 11:40:44 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:45 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" returned: 0 in 0.483s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" released by "_copy_volume_from_snapshot" :: held 11.712s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-922f33f2-eb8c-4d62-b51d-fad6bf275d0f-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" released by "_create_volume_from_snapshot" :: held 11.814s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.833s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.532s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c430e74-be5b-41dc-9ba9-0ec82cbdd7c8,created_at=2026-09-25T09:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1644638493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c430e74-be5b-41dc-9ba9-0ec82cbdd7c8,host='devstack@QuobyteHD#QuobyteHD',id=147165dc-1ea3-450d-a78d-18d8de24b11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c00a00ea46bbaa17f7bff9209816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:40Z,use_quota=True,user_id='e001582fc82e43fc967440cd174ada76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(692b3155-836f-4b3f-92a6-30dfbcdc78d1),volume_type_id=692b3155-836f-4b3f-92a6-30dfbcdc78d1)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Creating volume 147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:45 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:45 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b 1073741824 Sep 25 11:40:45 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e467ec39-3bb8-4898-bb07-03d89cc44811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92', 'volume_size': 2, 'snapshot_id': '922f33f2-eb8c-4d62-b51d-fad6bf275d0f'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d901e61-2deb-4780-b641-3946b214d8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:45 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Volume volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 (859fa3c8-f237-4ccf-9f43-0718e7cc9e92): created successfully Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d901e61-2deb-4780-b641-3946b214d8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (38199dae-86b2-4c07-af5b-ce2414835f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ef3ce51c-5283-4f07-aac7-235ad8c73caa tempest-VolumesSnapshotTestJSON-830189143 None] Created volume successfully. Sep 25 11:40:46 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b 1073741824" returned: 0 in 0.678s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:46 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b Sep 25 11:40:46 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-859fa3c8-f237-4ccf-9f43-0718e7cc9e92-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-859fa3c8-f237-4ccf-9f43-0718e7cc9e92-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[330750fc-c325-45e6-88bd-edb7ab3c9ba1]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:46 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b" returned: 0 in 0.560s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7bd39a-2b96-4959-9196-f06fe4fec58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-147165dc-1ea3-450d-a78d-18d8de24b11b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677c99df-0f29-4d27-aef8-05137493c0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:46 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Volume volume-147165dc-1ea3-450d-a78d-18d8de24b11b (147165dc-1ea3-450d-a78d-18d8de24b11b): created successfully Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677c99df-0f29-4d27-aef8-05137493c0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Flow 'volume_create_manager' (b2edbcf7-2c44-4e8f-8367-004f767dd796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:46 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 Sep 25 11:40:46 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:46 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-04761a88-d401-4416-90b1-a87da2239ebe tempest-GroupSnapshotsTest-1613358976 None] Created volume successfully. Sep 25 11:40:47 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" returned: 0 in 0.550s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:47 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92 Sep 25 11:40:47 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:47 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" returned: 0 in 0.396s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-859fa3c8-f237-4ccf-9f43-0718e7cc9e92" released by "delete_volume" :: held 1.029s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Created reservations ['90d4f200-5bc4-4c68-b42d-ab2b4450501c', '5b9bb566-5775-4f04-93e4-210841fd49f6', '752f44b9-aac2-49ae-9315-c381977fa7d2', 'de10949e-c38c-4bf9-a54e-5d2a3105606e'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:47 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:47 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] GroupSnapshot 7f4cb068-ad08-4e3a-a261-05707b6017c7: creating. Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Group snapshot 7f4cb068-ad08-4e3a-a261-05707b6017c7: creating. {{(pid=87356) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Creating offline snapshot 565c7ce8-ee6b-476e-baad-0ac3969c67d1 of volume 147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[68547b11-1bf7-4702-acc6-5800dd2f945b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:48 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.313s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:48 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Deleted volume successfully. Sep 25 11:40:48 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b Sep 25 11:40:48 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-591df358-7e3b-408e-9c1f-4030050c3acb tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-859fa3c8-f237-4ccf-9f43-0718e7cc9e92-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:48 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b" returned: 0 in 0.457s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:48 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 1G Sep 25 11:40:48 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-922f33f2-eb8c-4d62-b51d-fad6bf275d0f-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-922f33f2-eb8c-4d62-b51d-fad6bf275d0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-922f33f2-eb8c-4d62-b51d-fad6bf275d0f" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-922f33f2-eb8c-4d62-b51d-fad6bf275d0f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Deleting offline snapshot 922f33f2-eb8c-4d62-b51d-fad6bf275d0f of volume b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] snapshot_file for this snap is: volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9bbb2e-e532-476c-9f9b-7c0a95a21be7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:49 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 1G" returned: 0 in 0.681s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-147165dc-1ea3-450d-a78d-18d8de24b11b -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:49 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f Sep 25 11:40:49 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:49 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-147165dc-1ea3-450d-a78d-18d8de24b11b -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 Sep 25 11:40:49 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:49 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f" returned: 0 in 0.557s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:40:49 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-147165dc-1ea3-450d-a78d-18d8de24b11b -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1" returned: 0 in 0.456s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:49 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7606f7-0830-4a42-b9c7-98209a61d76c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:49 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 Sep 25 11:40:49 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:49 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 Sep 25 11:40:49 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:49 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1" returned: 0 in 0.400s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:50 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.info Sep 25 11:40:50 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:50 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" returned: 0 in 0.844s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:50 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f Sep 25 11:40:50 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:50 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.info" returned: 0 in 0.486s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:50 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:40:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:50 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.info Sep 25 11:40:50 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:50 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.info" returned: 0 in 0.380s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:51 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f" returned: 0 in 0.582s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:51 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f Sep 25 11:40:51 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:51 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c8f6edac-0994-4e46-82da-cd9d9b8dd998 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 7f4cb068-ad08-4e3a-a261-05707b6017c7: created successfully Sep 25 11:40:51 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4.922f33f2-eb8c-4d62-b51d-fad6bf275d0f" returned: 0 in 0.361s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-922f33f2-eb8c-4d62-b51d-fad6bf275d0f" released by "_delete_snapshot" :: held 2.528s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" released by "delete_snapshot" :: held 2.562s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:51 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Created reservations ['f9c4a756-9e7c-4250-9a9f-f35242c40610', '4bb771bf-f1f7-4892-a5a6-296e4ac7d28e', '756a68ec-5ca2-4bfc-a791-5716f2f31e85', '40c233e8-f2c4-492a-84ea-2f6528a2e6c3'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:51 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Delete snapshot completed successfully. Sep 25 11:40:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bc21b6f-dcef-441f-8931-19fcb429ef2f tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-922f33f2-eb8c-4d62-b51d-fad6bf275d0f-delete_snapshot" released by "delete_snapshot" :: held 2.782s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-565c7ce8-ee6b-476e-baad-0ac3969c67d1-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-565c7ce8-ee6b-476e-baad-0ac3969c67d1-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Creating volume ed5d8dc4-a48d-458c-a930-50f72ae2e58c from snapshot 565c7ce8-ee6b-476e-baad-0ac3969c67d1 {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] snapshot: 565c7ce8-ee6b-476e-baad-0ac3969c67d1, volume: ed5d8dc4-a48d-458c-a930-50f72ae2e58c, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecff4be3-7f6d-439d-9ae9-c78bbc360722]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" acquired by "delete_volume" :: waited 0.043s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:52 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 Sep 25 11:40:52 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a8cbcf-31fd-4d74-80d4-fac8ad22bb1f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:52 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 Sep 25 11:40:52 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:53 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1" returned: 0 in 0.633s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-147165dc-1ea3-450d-a78d-18d8de24b11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217e1b8-6ef0-4c41-b01f-6129801f33d2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:53 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" returned: 0 in 0.592s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:53 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b Sep 25 11:40:53 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:53 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4 Sep 25 11:40:53 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:53 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b" returned: 0 in 0.607s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:40:53 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:53 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c Sep 25 11:40:53 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4" released by "delete_volume" :: held 1.162s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=95,cinder:UPDATE=104,cinder:DELETE=7,cinder:INSERT=21 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:40:53 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Created reservations ['332e1024-506e-448b-bce4-f283a9fa1b4e', 'ab1f8226-c6ca-4649-9aee-99b61767ac5c', 'd50b07b9-e8d0-4707-87a7-a250044adf7b', 'eef9bef1-5fb0-41f2-84de-360224d8afc5'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:54 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:40:54 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:54 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.461s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Deleted volume successfully. Sep 25 11:40:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfb5f6bb-965c-4416-8dbe-11c60ca8f780 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-b99eb1a9-fe54-4f2a-b9fc-1e3aa2f6fbe4-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=113,cinder:UPDATE=93,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (e4b475c6-bb3a-45fe-b7dd-d53c0df2d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853f63ac-8936-48aa-9f8d-99c88b0da1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853f63ac-8936-48aa-9f8d-99c88b0da1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-30892442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fa3057-d7a2-42ff-99f9-05b7e6b80891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d05a14b87d4c14b5225f9284a8c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:56Z,use_quota=True,user_id='c8a826d21343496cb8aae2593fba23d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373a46b2-b9d6-4cbd-a6ba-2daf37df4609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373a46b2-b9d6-4cbd-a6ba-2daf37df4609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b2e223-3d4f-4138-8267-3b9bd0fa0b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b2e223-3d4f-4138-8267-3b9bd0fa0b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0fa3057-d7a2-42ff-99f9-05b7e6b80891', 'volume_name': 'volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd604d6-bac8-4d12-baff-f8eadb76709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd604d6-bac8-4d12-baff-f8eadb76709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d91a180-8673-4494-baf0-a2f35fdff40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:56 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Volume e0fa3057-d7a2-42ff-99f9-05b7e6b80891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891', 'volume_size': 1} Sep 25 11:40:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (58e90374-92e3-4112-8a81-dcbe638b0257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22c6961-561f-41d3-b422-29fb4f8f9b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22c6961-561f-41d3-b422-29fb4f8f9b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901732634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5921686c-a679-421c-8368-cacda6f96723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:57Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4489c8c-0437-40d9-a4b0-290075451e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4489c8c-0437-40d9-a4b0-290075451e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aa78e2-c173-4ed2-a69b-3892216d2c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aa78e2-c173-4ed2-a69b-3892216d2c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5921686c-a679-421c-8368-cacda6f96723', 'volume_name': 'volume-5921686c-a679-421c-8368-cacda6f96723', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4824e458-3b2b-4774-86f0-30a1719d2118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4824e458-3b2b-4774-86f0-30a1719d2118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd594b98-3f58-40a3-92e0-528059105324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:57 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume 5921686c-a679-421c-8368-cacda6f96723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5921686c-a679-421c-8368-cacda6f96723', 'volume_size': 1} Sep 25 11:40:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:02 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" returned: 0 in 8.568s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:41:02 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Converted 1024.00 MB image at 119.50 MB/s Sep 25 11:41:02 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:02 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c Sep 25 11:41:02 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:02 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" returned: 0 in 0.358s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" released by "_copy_volume_from_snapshot" :: held 10.430s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-565c7ce8-ee6b-476e-baad-0ac3969c67d1-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" released by "_create_volume_from_snapshot" :: held 10.560s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.587s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.877s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-30892442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fa3057-d7a2-42ff-99f9-05b7e6b80891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d05a14b87d4c14b5225f9284a8c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:56Z,use_quota=True,user_id='c8a826d21343496cb8aae2593fba23d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Creating volume e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:02 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:02 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 1073741824 Sep 25 11:41:02 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:02 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9c043c42-3908-4fe5-9ae8-97442c002fee tempest-GroupSnapshotsTest-1613358976 None] Create group from source-snapshot-7f4cb068-ad08-4e3a-a261-05707b6017c7 completed successfully. Sep 25 11:41:03 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 1073741824" returned: 0 in 0.638s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:03 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 Sep 25 11:41:03 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:03 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" returned: 0 in 0.323s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.399s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901732634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5921686c-a679-421c-8368-cacda6f96723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:57Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Creating volume 5921686c-a679-421c-8368-cacda6f96723 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:03 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:03 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 1073741824 Sep 25 11:41:03 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d91a180-8673-4494-baf0-a2f35fdff40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e375f3-76b5-4deb-9bb1-556b2de1f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:03 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Volume volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 (e0fa3057-d7a2-42ff-99f9-05b7e6b80891): created successfully Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e375f3-76b5-4deb-9bb1-556b2de1f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (e4b475c6-bb3a-45fe-b7dd-d53c0df2d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:03 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5b23d991-0072-40eb-bc13-fcbf2fa4ca1e tempest-VolumesSnapshotTestJSON-830189143 None] Created volume successfully. Sep 25 11:41:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" acquired by "delete_volume" :: waited 0.037s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be5496b-bb70-4395-a1ac-fd0746408a57]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:04 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c Sep 25 11:41:04 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:04 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" returned: 0 in 0.461s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:04 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 1073741824" returned: 0 in 0.668s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:04 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c Sep 25 11:41:04 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:04 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 Sep 25 11:41:04 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:04 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723" returned: 0 in 0.353s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:04 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd594b98-3f58-40a3-92e0-528059105324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5921686c-a679-421c-8368-cacda6f96723', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d52970f-1a17-45b3-9edd-937b8c945be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" returned: 0 in 0.474s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:05 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume volume-5921686c-a679-421c-8368-cacda6f96723 (5921686c-a679-421c-8368-cacda6f96723): created successfully Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d52970f-1a17-45b3-9edd-937b8c945be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (58e90374-92e3-4112-8a81-dcbe638b0257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-ed5d8dc4-a48d-458c-a930-50f72ae2e58c" released by "delete_volume" :: held 1.039s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e2f7e177-748c-4d41-a0f5-446fc8baeef3 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created volume successfully. Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Creating offline snapshot 8a34286d-51b5-412c-bfca-c190c0cb86ea of volume e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e59548-0f34-4098-b193-f80557cc247d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['7cbad9a4-f732-4694-ac8d-825e8301682a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:05 devstack cinder-volume[87356]: WARNING cinder.quota [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1501579253 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1501579253, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:41:05 devstack cinder-volume[87356]: WARNING cinder.quota [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1501579253 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1501579253, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['f2e783bf-3e17-47a6-87f1-81b67e0d998b', 'ca6f315f-ee7b-45be-a2dc-5d512302a413', '03343de3-85c9-4f23-8d95-92ba945319cf', 'c3330222-b80e-4407-999b-22b9b0a97e79'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:05 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 Sep 25 11:41:05 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:05 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:05 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:05 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" returned: 0 in 0.489s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:05 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea 1G Sep 25 11:41:05 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:05 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.305s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:05 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-baa70c2f-a80b-4d77-92e2-d9e576aeea60 tempest-GroupSnapshotsTest-1613358976 None] Delete group completed successfully. Sep 25 11:41:06 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea 1G" returned: 0 in 0.500s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:06 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea Sep 25 11:41:06 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:06 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea" returned: 0 in 0.390s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:06 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea is being set with open permissions: ugo+rw Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:06 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea Sep 25 11:41:06 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:06 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 7f4cb068-ad08-4e3a-a261-05707b6017c7: deleting Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 7f4cb068-ad08-4e3a-a261-05707b6017c7: deleting {{(pid=87356) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-147165dc-1ea3-450d-a78d-18d8de24b11b" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-147165dc-1ea3-450d-a78d-18d8de24b11b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-565c7ce8-ee6b-476e-baad-0ac3969c67d1" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-565c7ce8-ee6b-476e-baad-0ac3969c67d1" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Deleting offline snapshot 565c7ce8-ee6b-476e-baad-0ac3969c67d1 of volume 147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] snapshot_file for this snap is: volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fe0696-dcf8-4b42-bfc9-e5d8209f6fed]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:06 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea" returned: 0 in 0.403s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (6e8d3b0e-30ee-467e-8b1c-95a1382e639e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:06 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 Sep 25 11:41:06 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5913e592-e909-4903-8536-90a4be547fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5913e592-e909-4903-8536-90a4be547fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074759737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4dfbfc-82d2-4554-a599-fa599c48623a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:07Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e46610-0e04-4412-823f-cf12ab05ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e46610-0e04-4412-823f-cf12ab05ce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bdf596-3e75-421a-9850-ba70bd0cb681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bdf596-3e75-421a-9850-ba70bd0cb681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4dfbfc-82d2-4554-a599-fa599c48623a', 'volume_name': 'volume-2c4dfbfc-82d2-4554-a599-fa599c48623a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f924548-7da1-4f07-878e-b766bc7e2c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.info Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f924548-7da1-4f07-878e-b766bc7e2c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:07 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9455575c-33bb-43ea-8242-47c6c7577735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume 2c4dfbfc-82d2-4554-a599-fa599c48623a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4dfbfc-82d2-4554-a599-fa599c48623a', 'volume_size': 1} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (f2898592-e5a1-4955-a392-0284c21c98ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6deee34-1d9f-455b-8765-186fe8bd01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6deee34-1d9f-455b-8765-186fe8bd01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1081957463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c20d54-8563-4761-8750-6a0b0313b4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:07Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8281dbb-042b-4ebf-aa1a-8d5fad293951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8281dbb-042b-4ebf-aa1a-8d5fad293951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76a2f73-485d-49f1-840c-afc5f498d737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76a2f73-485d-49f1-840c-afc5f498d737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c20d54-8563-4761-8750-6a0b0313b4a0', 'volume_name': 'volume-04c20d54-8563-4761-8750-6a0b0313b4a0', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40bd6ac-06bd-455b-a5e9-0f57710bdfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40bd6ac-06bd-455b-a5e9-0f57710bdfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:07 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fb7e45-eb28-49a9-b392-e470de6f656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:07 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume 04c20d54-8563-4761-8750-6a0b0313b4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c20d54-8563-4761-8750-6a0b0313b4a0', 'volume_size': 1} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1" returned: 0 in 0.727s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-147165dc-1ea3-450d-a78d-18d8de24b11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:41:07 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a019586-5133-4bd2-97b4-0162e4636d3e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.info" returned: 0 in 0.605s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:07 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.info is being set with open permissions: ugo+rw Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:07 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.info Sep 25 11:41:07 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:07 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b Sep 25 11:41:07 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:07 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.info" returned: 0 in 0.371s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.935s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074759737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4dfbfc-82d2-4554-a599-fa599c48623a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:07Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Creating volume 2c4dfbfc-82d2-4554-a599-fa599c48623a {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:08 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:08 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a 1073741824 Sep 25 11:41:08 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (26487c09-a0d0-42e0-9bf5-75b9674f7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd43f5d9-c7ad-4e22-b3aa-73589f75f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd43f5d9-c7ad-4e22-b3aa-73589f75f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736498536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854cc078-cb65-426a-8287-87b8fc38fdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:08Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d221a23-c58f-4b2b-8646-2b65b4996a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d221a23-c58f-4b2b-8646-2b65b4996a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32f6436-04fe-42de-b1e2-f6bfd6f10752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32f6436-04fe-42de-b1e2-f6bfd6f10752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '854cc078-cb65-426a-8287-87b8fc38fdcb', 'volume_name': 'volume-854cc078-cb65-426a-8287-87b8fc38fdcb', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b71be3d-8be4-4dbe-8599-06158cd2d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b71be3d-8be4-4dbe-8599-06158cd2d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b298982c-61e7-4dc2-b4e1-5049a3f77f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume 854cc078-cb65-426a-8287-87b8fc38fdcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-854cc078-cb65-426a-8287-87b8fc38fdcb', 'volume_size': 1} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:08 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fa1496f2-304e-44e7-9ba9-185c00538048 tempest-VolumesSnapshotTestJSON-830189143 None] Create snapshot completed successfully Sep 25 11:41:08 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b" returned: 0 in 0.926s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:08 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 Sep 25 11:41:08 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (8079c49b-a8c6-4e4f-a010-0ffece5967c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4dcaa8-57f5-40db-a166-3ea5b36fdb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4dcaa8-57f5-40db-a166-3ea5b36fdb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522636929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467c5a63-2c17-4192-8e8d-d0404ee3ead2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:08Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ad02c7-3a35-4a68-9bc0-2055316fa3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ad02c7-3a35-4a68-9bc0-2055316fa3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5cb9ec-fa48-4a88-a6a2-df1c941ee4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5cb9ec-fa48-4a88-a6a2-df1c941ee4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467c5a63-2c17-4192-8e8d-d0404ee3ead2', 'volume_name': 'volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31371b4-781a-46de-a160-bd22618b4b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31371b4-781a-46de-a160-bd22618b4b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecf875a-7fc1-4b4f-8569-4204d524882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:08 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume 467c5a63-2c17-4192-8e8d-d0404ee3ead2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2', 'volume_size': 1} Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:08 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a 1073741824" returned: 0 in 0.896s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:09 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a Sep 25 11:41:09 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:09 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (29b02dec-f9ad-45c4-858a-536dc4c306e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f77087-453d-4844-b065-2dbd8e871a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1" returned: 0 in 0.709s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:09 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1 Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f77087-453d-4844-b065-2dbd8e871a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419474127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c44268-e5a2-4427-9d44-33b0b2e0d898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:09Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f594cc-2713-4507-95bb-e801ddec4f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f594cc-2713-4507-95bb-e801ddec4f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa420599-3c7b-4a08-b12f-666586b5f3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa420599-3c7b-4a08-b12f-666586b5f3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c44268-e5a2-4427-9d44-33b0b2e0d898', 'volume_name': 'volume-61c44268-e5a2-4427-9d44-33b0b2e0d898', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3460e72-ca31-419f-8420-ab9351d7041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3460e72-ca31-419f-8420-ab9351d7041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06527e7-b8cc-4a07-ab66-cbb0d217e11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume 61c44268-e5a2-4427-9d44-33b0b2e0d898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c44268-e5a2-4427-9d44-33b0b2e0d898', 'volume_size': 1} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (ae6f3168-e5a3-442e-bf81-7513f2ad48a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0893cf-eb38-4a4c-aea3-a3081e2e2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b.565c7ce8-ee6b-476e-baad-0ac3969c67d1" returned: 0 in 0.442s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:09 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0893cf-eb38-4a4c-aea3-a3081e2e2e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2016468195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f783fa3-532d-4e1b-8180-328730ad9be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d05a14b87d4c14b5225f9284a8c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a34286d-51b5-412c-bfca-c190c0cb86ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:10Z,use_quota=True,user_id='c8a826d21343496cb8aae2593fba23d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2084072c-1afb-4828-a766-91342a429d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2084072c-1afb-4828-a766-91342a429d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd89c33-b072-41b5-a893-431f5d4c60a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd89c33-b072-41b5-a893-431f5d4c60a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f783fa3-532d-4e1b-8180-328730ad9be1', 'volume_name': 'volume-1f783fa3-532d-4e1b-8180-328730ad9be1', 'volume_size': 1, 'snapshot_id': '8a34286d-51b5-412c-bfca-c190c0cb86ea'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304ab240-aa87-448a-a373-8367859119e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304ab240-aa87-448a-a373-8367859119e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f401ab0-b5d4-49a4-a8aa-e07b048f0e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Volume 1f783fa3-532d-4e1b-8180-328730ad9be1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f783fa3-532d-4e1b-8180-328730ad9be1', 'volume_size': 1, 'snapshot_id': '8a34286d-51b5-412c-bfca-c190c0cb86ea'} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-565c7ce8-ee6b-476e-baad-0ac3969c67d1" released by "_delete_snapshot" :: held 3.042s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a" returned: 0 in 0.687s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-147165dc-1ea3-450d-a78d-18d8de24b11b" released by "delete_snapshot" :: held 3.105s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.259s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1081957463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c20d54-8563-4761-8750-6a0b0313b4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:07Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Creating volume 04c20d54-8563-4761-8750-6a0b0313b4a0 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:09 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:09 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 1073741824 Sep 25 11:41:09 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9455575c-33bb-43ea-8242-47c6c7577735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4dfbfc-82d2-4554-a599-fa599c48623a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d348bc6-d81c-45ea-97fd-6862b742ac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume volume-2c4dfbfc-82d2-4554-a599-fa599c48623a (2c4dfbfc-82d2-4554-a599-fa599c48623a): created successfully Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d348bc6-d81c-45ea-97fd-6862b742ac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (6e8d3b0e-30ee-467e-8b1c-95a1382e639e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:09 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-50d7c62e-3ee9-4481-914f-8e6fae7274e1 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created volume successfully. Sep 25 11:41:09 devstack cinder-volume[87356]: WARNING cinder.quota [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1501579253 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1501579253, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['28200143-4f63-4c67-bcb6-7957b7c4d8bb', '8aa41f2d-2f5b-44b4-b2db-a0601f9e8867', 'ff7085de-df9e-43ae-8302-e3b73306d29b', '3a33b391-5ef9-4045-9143-6ecc60fe9e36'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d3db16f8-10fa-428a-bf1d-6af879df5d94 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 7f4cb068-ad08-4e3a-a261-05707b6017c7: deleted successfully Sep 25 11:41:10 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 1073741824" returned: 0 in 0.650s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:10 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 Sep 25 11:41:10 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:10 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0" returned: 0 in 0.285s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.360s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736498536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854cc078-cb65-426a-8287-87b8fc38fdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:08Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Creating volume 854cc078-cb65-426a-8287-87b8fc38fdcb {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:10 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:10 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb 1073741824 Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fb7e45-eb28-49a9-b392-e470de6f656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c20d54-8563-4761-8750-6a0b0313b4a0', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:10 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6d4f5e-e40d-48ca-b528-330a2230d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:10 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume volume-04c20d54-8563-4761-8750-6a0b0313b4a0 (04c20d54-8563-4761-8750-6a0b0313b4a0): created successfully Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6d4f5e-e40d-48ca-b528-330a2230d264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (f2898592-e5a1-4955-a392-0284c21c98ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ad811289-f5e8-4d22-a265-f84a826844cb tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created volume successfully. Sep 25 11:41:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-147165dc-1ea3-450d-a78d-18d8de24b11b" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-147165dc-1ea3-450d-a78d-18d8de24b11b" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f332e-943d-4c6e-8c45-9d0e1ea6d6eb]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:11 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb 1073741824" returned: 0 in 0.881s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:11 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb Sep 25 11:41:11 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:11 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b Sep 25 11:41:11 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:12 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb" returned: 0 in 0.355s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.310s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522636929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467c5a63-2c17-4192-8e8d-d0404ee3ead2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:08Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Creating volume 467c5a63-2c17-4192-8e8d-d0404ee3ead2 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:12 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b298982c-61e7-4dc2-b4e1-5049a3f77f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-854cc078-cb65-426a-8287-87b8fc38fdcb', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddea842-d0ea-46e8-b2ec-0c11e3c46a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:12 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume volume-854cc078-cb65-426a-8287-87b8fc38fdcb (854cc078-cb65-426a-8287-87b8fc38fdcb): created successfully Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddea842-d0ea-46e8-b2ec-0c11e3c46a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (26487c09-a0d0-42e0-9bf5-75b9674f7abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:12 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 1073741824 Sep 25 11:41:12 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:12 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-eb71a4ec-f0d9-4135-a4ea-ec00ee6e41dd tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created volume successfully. Sep 25 11:41:12 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b" returned: 0 in 0.745s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:12 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b Sep 25 11:41:12 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:12 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-147165dc-1ea3-450d-a78d-18d8de24b11b" returned: 0 in 0.352s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-147165dc-1ea3-450d-a78d-18d8de24b11b" released by "delete_volume" :: held 1.208s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['f9ed4b4d-129d-4a65-b8a7-bbd5a9b6093f'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:13 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:13 devstack cinder-volume[87356]: WARNING cinder.db.api [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1501579253'] Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 1073741824" returned: 0 in 0.846s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['2b07b1a1-fbd7-47be-9479-bb2e12b471e8', '7498fb8f-3c1a-41aa-bd8f-5283f1df0b6c', '74ae896e-d432-4fd9-b42f-4d184bec685a', '6963d53e-8c6a-4006-9182-1f02c752c611'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:13 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 Sep 25 11:41:13 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:13 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:13 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:13 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2" returned: 0 in 0.373s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.034s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419474127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c44268-e5a2-4427-9d44-33b0b2e0d898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aafdd715ca427dbc07cd083d8a662b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:09Z,use_quota=True,user_id='5c7da2c41dd8404db1b8e00fa33cd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Creating volume 61c44268-e5a2-4427-9d44-33b0b2e0d898 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:13 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecf875a-7fc1-4b4f-8569-4204d524882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e09bf4-faf6-4063-9fb6-32e5a3a6593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:13 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 1073741824 Sep 25 11:41:13 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:13 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 (467c5a63-2c17-4192-8e8d-d0404ee3ead2): created successfully Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e09bf4-faf6-4063-9fb6-32e5a3a6593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (8079c49b-a8c6-4e4f-a010-0ffece5967c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b863b044-a523-4a14-af64-86fd04bb9628 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created volume successfully. Sep 25 11:41:13 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.403s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:13 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-72e31a96-dcba-4e23-be0c-f9f612d1b1be tempest-GroupSnapshotsTest-1613358976 None] Delete group completed successfully. Sep 25 11:41:14 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 1073741824" returned: 0 in 0.529s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:14 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 Sep 25 11:41:14 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:14 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898" returned: 0 in 0.404s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.653s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-8a34286d-51b5-412c-bfca-c190c0cb86ea-1f783fa3-532d-4e1b-8180-328730ad9be1" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06527e7-b8cc-4a07-ab66-cbb0d217e11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c44268-e5a2-4427-9d44-33b0b2e0d898', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afd245d-ca47-43f7-8ad8-4015280c8272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-8a34286d-51b5-412c-bfca-c190c0cb86ea-1f783fa3-532d-4e1b-8180-328730ad9be1" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Creating volume 1f783fa3-532d-4e1b-8180-328730ad9be1 from snapshot 8a34286d-51b5-412c-bfca-c190c0cb86ea {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-1f783fa3-532d-4e1b-8180-328730ad9be1" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:14 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Volume volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 (61c44268-e5a2-4427-9d44-33b0b2e0d898): created successfully Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afd245d-ca47-43f7-8ad8-4015280c8272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Flow 'volume_create_manager' (29b02dec-f9ad-45c4-858a-536dc4c306e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-1f783fa3-532d-4e1b-8180-328730ad9be1" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] snapshot: 8a34286d-51b5-412c-bfca-c190c0cb86ea, volume: 1f783fa3-532d-4e1b-8180-328730ad9be1, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:41:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b6bf3951-eeaf-4bfc-b4de-66c95f90436c tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created volume successfully. Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[392cbea5-12df-46a8-b385-99d370c11822]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-61c44268-e5a2-4427-9d44-33b0b2e0d898-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c0c59c66-ffe0-4783-b349-d636c0c70b5d tempest-GroupSnapshotsTest-1613358976 None] Group tempest-GroupSnapshotsTest-Group-1651826789: creating Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-61c44268-e5a2-4427-9d44-33b0b2e0d898-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-quobyte-61c44268-e5a2-4427-9d44-33b0b2e0d898" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c0c59c66-ffe0-4783-b349-d636c0c70b5d tempest-GroupSnapshotsTest-1613358976 None] Group tempest-GroupSnapshotsTest-Group-1651826789: created successfully Sep 25 11:41:15 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea Sep 25 11:41:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c0c59c66-ffe0-4783-b349-d636c0c70b5d tempest-GroupSnapshotsTest-1613358976 None] Create group completed successfully. Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-61c44268-e5a2-4427-9d44-33b0b2e0d898" acquired by "delete_volume" :: waited 0.041s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:15 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c04819c-f117-4210-a395-5f8995bd16e6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:15 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 Sep 25 11:41:15 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:15 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea" returned: 0 in 0.755s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3431a61c-4193-4544-94d1-d34e2ce96cd7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:15 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 Sep 25 11:41:15 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:15 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898" returned: 0 in 0.849s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:16 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898 Sep 25 11:41:16 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:16 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" returned: 0 in 0.854s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:16 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 Sep 25 11:41:16 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:16 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-61c44268-e5a2-4427-9d44-33b0b2e0d898" returned: 0 in 0.579s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-61c44268-e5a2-4427-9d44-33b0b2e0d898" released by "delete_volume" :: held 1.591s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created reservations ['6eb50fb7-69f0-42a3-abee-ed02890fd981', '125db65f-90b6-408d-b0d3-a3b34782ff6d', '82f27d7c-91f1-4996-a829-68ebd7f6887e', '52dff5ed-0806-478c-85a9-880743c13732'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:16 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:16 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Flow 'volume_create_manager' (4c7b36e0-bb09-4aa3-bd78-388ce9955db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a4c8a6-0967-4dbe-b3eb-f0e9696a67df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a4c8a6-0967-4dbe-b3eb-f0e9696a67df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1130361663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a86dd215-9a75-4d93-b852-c3f2a117b7c5,host='devstack@QuobyteHD#QuobyteHD',id=bb46a049-98fe-4f25-b060-db0b6b635452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c00a00ea46bbaa17f7bff9209816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:17Z,use_quota=True,user_id='e001582fc82e43fc967440cd174ada76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69ef6e2-b0f7-43ed-a920-94c172b9ead7),volume_type_id=d69ef6e2-b0f7-43ed-a920-94c172b9ead7)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ab770b-078c-4f5d-8720-41cfbe83497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ab770b-078c-4f5d-8720-41cfbe83497f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8a83da-f918-4f86-97b1-0c70635ad7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:17 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8a83da-f918-4f86-97b1-0c70635ad7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb46a049-98fe-4f25-b060-db0b6b635452', 'volume_name': 'volume-bb46a049-98fe-4f25-b060-db0b6b635452', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e97085e-2d20-4d37-a550-08e8c59be8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e97085e-2d20-4d37-a550-08e8c59be8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4fa2ef-c144-42fe-8ad7-df9109b720d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:17 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Volume bb46a049-98fe-4f25-b060-db0b6b635452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb46a049-98fe-4f25-b060-db0b6b635452', 'volume_size': 1} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-467c5a63-2c17-4192-8e8d-d0404ee3ead2-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.835s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Deleted volume successfully. Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-467c5a63-2c17-4192-8e8d-d0404ee3ead2-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6f2ffb0c-be55-4e8a-92ff-382fe569d0b8 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-61c44268-e5a2-4427-9d44-33b0b2e0d898-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-quobyte-467c5a63-2c17-4192-8e8d-d0404ee3ead2" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-467c5a63-2c17-4192-8e8d-d0404ee3ead2" acquired by "delete_volume" :: waited 0.054s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:18 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b376149c-2bb0-4d74-a886-a777ba699b5c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:18 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 Sep 25 11:41:18 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:19 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2" returned: 0 in 1.154s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:19 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2 Sep 25 11:41:19 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:20 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-467c5a63-2c17-4192-8e8d-d0404ee3ead2" returned: 0 in 0.975s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-467c5a63-2c17-4192-8e8d-d0404ee3ead2" released by "delete_volume" :: held 2.316s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created reservations ['203d8bd3-5d14-4801-8acc-b66b5d3282f7', 'e179017b-22d7-4934-b116-66f40bcd630e', '0521e6dc-9206-40a3-9591-cb64a7506289', 'a71a5a21-be7f-4910-a901-7ce15a40f6f9'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:21 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:21 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-854cc078-cb65-426a-8287-87b8fc38fdcb-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-854cc078-cb65-426a-8287-87b8fc38fdcb-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:22 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 1.200s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:22 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Deleted volume successfully. Sep 25 11:41:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-quobyte-854cc078-cb65-426a-8287-87b8fc38fdcb" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ce1cff5-a7ef-40b5-9443-1514f315d8f5 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-467c5a63-2c17-4192-8e8d-d0404ee3ead2-delete_volume" released by "delete_volume" :: held 4.542s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-854cc078-cb65-426a-8287-87b8fc38fdcb" acquired by "delete_volume" :: waited 0.058s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:22 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60260ff-9870-4747-9819-c757d1326180]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:22 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb Sep 25 11:41:22 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:23 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:23 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:23 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb" returned: 0 in 1.190s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:23 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb Sep 25 11:41:23 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:24 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.844s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:24 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:24 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:41:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:41:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:41:24 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-854cc078-cb65-426a-8287-87b8fc38fdcb" returned: 0 in 0.901s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-854cc078-cb65-426a-8287-87b8fc38fdcb" released by "delete_volume" :: held 2.289s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:24 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created reservations ['4f76241a-e4a1-4d10-83e5-83ebf646ccc3', '4dd5707c-ad2b-4087-bde1-9f7bd7c630cf', '2954b8dd-3b20-47d8-b7e1-2e07c50ee62c', '7b785856-3913-40bf-95ac-9acc114f9254'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:25 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:25 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:25 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.782s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:25 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Deleted volume successfully. Sep 25 11:41:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-04c20d54-8563-4761-8750-6a0b0313b4a0-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-04c20d54-8563-4761-8750-6a0b0313b4a0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a199928b-a92f-479b-92ab-04fe396669f7 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-854cc078-cb65-426a-8287-87b8fc38fdcb-delete_volume" released by "delete_volume" :: held 4.109s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-quobyte-04c20d54-8563-4761-8750-6a0b0313b4a0" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-04c20d54-8563-4761-8750-6a0b0313b4a0" acquired by "delete_volume" :: waited 0.037s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:26 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b4001-17b0-48c3-988c-663ae230d384]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:27 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 Sep 25 11:41:27 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:28 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0" returned: 0 in 1.735s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:28 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0 Sep 25 11:41:28 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:28 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1" returned: 0 in 12.118s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891, size 1024.00 MB, duration 12.12 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:41:28 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Converted 1024.00 MB image at 84.49 MB/s Sep 25 11:41:28 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 is being set with open permissions: ugo+rw Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:28 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 Sep 25 11:41:28 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:28 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-04c20d54-8563-4761-8750-6a0b0313b4a0" returned: 0 in 0.478s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-04c20d54-8563-4761-8750-6a0b0313b4a0" released by "delete_volume" :: held 2.374s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created reservations ['f9029631-f6ff-4669-b177-732f250d3953', 'db48895b-7b46-434a-ba32-f6817e35704c', '749bbea1-0af3-4491-acb4-e8cc4cb631b2', '2c2b84db-730f-4444-aa20-96c6da62c745'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:28 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1" returned: 0 in 0.308s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-1f783fa3-532d-4e1b-8180-328730ad9be1" released by "_copy_volume_from_snapshot" :: held 14.214s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:28 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:28 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-8a34286d-51b5-412c-bfca-c190c0cb86ea-1f783fa3-532d-4e1b-8180-328730ad9be1" released by "_create_volume_from_snapshot" :: held 14.351s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.419s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.198s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a86dd215-9a75-4d93-b852-c3f2a117b7c5,created_at=2026-09-25T09:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1130361663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a86dd215-9a75-4d93-b852-c3f2a117b7c5,host='devstack@QuobyteHD#QuobyteHD',id=bb46a049-98fe-4f25-b060-db0b6b635452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c00a00ea46bbaa17f7bff9209816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:17Z,use_quota=True,user_id='e001582fc82e43fc967440cd174ada76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69ef6e2-b0f7-43ed-a920-94c172b9ead7),volume_type_id=d69ef6e2-b0f7-43ed-a920-94c172b9ead7)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Creating volume bb46a049-98fe-4f25-b060-db0b6b635452 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:28 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:29 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 1073741824 Sep 25 11:41:29 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f401ab0-b5d4-49a4-a8aa-e07b048f0e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f783fa3-532d-4e1b-8180-328730ad9be1', 'volume_size': 1, 'snapshot_id': '8a34286d-51b5-412c-bfca-c190c0cb86ea'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543e8397-3607-43c9-a700-d6faf0798e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:29 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Volume volume-1f783fa3-532d-4e1b-8180-328730ad9be1 (1f783fa3-532d-4e1b-8180-328730ad9be1): created successfully Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543e8397-3607-43c9-a700-d6faf0798e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Flow 'volume_create_manager' (ae6f3168-e5a3-442e-bf81-7513f2ad48a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9487b4b6-4fc5-42e5-b8f9-f5bbc9952000 tempest-VolumesSnapshotTestJSON-830189143 None] Created volume successfully. Sep 25 11:41:29 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.340s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Deleted volume successfully. Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdbed24e-9d07-410c-8f87-62d387dcb86d tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-04c20d54-8563-4761-8750-6a0b0313b4a0-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-1f783fa3-532d-4e1b-8180-328730ad9be1-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-1f783fa3-532d-4e1b-8180-328730ad9be1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-1f783fa3-532d-4e1b-8180-328730ad9be1" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-1f783fa3-532d-4e1b-8180-328730ad9be1" acquired by "delete_volume" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f5d273-f79a-4bdf-adc6-1782d6f4abaa]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:29 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 1073741824" returned: 0 in 0.813s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:29 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 Sep 25 11:41:29 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-2c4dfbfc-82d2-4554-a599-fa599c48623a-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:29 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 Sep 25 11:41:29 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-2c4dfbfc-82d2-4554-a599-fa599c48623a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-quobyte-2c4dfbfc-82d2-4554-a599-fa599c48623a" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-2c4dfbfc-82d2-4554-a599-fa599c48623a" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d07d900-ba51-435f-96a3-c92d19009eb6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:30 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:30 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a Sep 25 11:41:30 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4fa2ef-c144-42fe-8ad7-df9109b720d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb46a049-98fe-4f25-b060-db0b6b635452', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90d7819-588f-48dd-a48a-860c5e13c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:30 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:30 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Volume volume-bb46a049-98fe-4f25-b060-db0b6b635452 (bb46a049-98fe-4f25-b060-db0b6b635452): created successfully Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90d7819-588f-48dd-a48a-860c5e13c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Flow 'volume_create_manager' (4c7b36e0-bb09-4aa3-bd78-388ce9955db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1" returned: 0 in 0.728s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:30 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5e9af06b-8c44-4501-b358-7002adfe4689 tempest-GroupSnapshotsTest-1613358976 None] Created volume successfully. Sep 25 11:41:30 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1 Sep 25 11:41:30 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:30 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a" returned: 0 in 0.524s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:30 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a Sep 25 11:41:30 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:30 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1f783fa3-532d-4e1b-8180-328730ad9be1" returned: 0 in 0.395s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-1f783fa3-532d-4e1b-8180-328730ad9be1" released by "delete_volume" :: held 1.203s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Created reservations ['6ba579de-cc48-4ab7-8784-f8e8d1e6f5a8', '3475d6b7-4c80-4c28-a38b-eb7f1d05e98d', '6b84b84f-724c-4586-91cf-f4cc3d4ca73b', '9a460432-3aeb-4b1c-9662-9926a65d7ce0'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:31 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2c4dfbfc-82d2-4554-a599-fa599c48623a" returned: 0 in 0.417s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:31 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:31 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-2c4dfbfc-82d2-4554-a599-fa599c48623a" released by "delete_volume" :: held 1.028s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created reservations ['ee0d8c31-3939-4f92-9419-847ae2118715', '843a83ed-bede-4744-8642-fd0e71ceff04', '53e36cb2-f879-493a-91b5-b536c4aa20eb', '6028512f-cdcb-4067-87b4-8d85e7f2d7ac'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:31 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.366s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Deleted volume successfully. Sep 25 11:41:31 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:31 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6353f9d9-9050-4bb1-ba6e-f1787a1231f6 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-1f783fa3-532d-4e1b-8180-328730ad9be1-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:31 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Flow 'volume_create_manager' (81791402-30a0-434c-8a85-ae55ddd68669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24b27ec-e2b3-49bb-af90-16e7b0606221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.497s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-8a34286d-51b5-412c-bfca-c190c0cb86ea-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Deleted volume successfully. Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24b27ec-e2b3-49bb-af90-16e7b0606221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1253662255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a86dd215-9a75-4d93-b852-c3f2a117b7c5,host='devstack@QuobyteHD#QuobyteHD',id=dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c00a00ea46bbaa17f7bff9209816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:32Z,use_quota=True,user_id='e001582fc82e43fc967440cd174ada76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69ef6e2-b0f7-43ed-a920-94c172b9ead7),volume_type_id=d69ef6e2-b0f7-43ed-a920-94c172b9ead7)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4b139b-8372-48d1-812f-6df7ff5597dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4b139b-8372-48d1-812f-6df7ff5597dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd81f712-29c2-41cd-b224-fbc6209139bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd81f712-29c2-41cd-b224-fbc6209139bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e', 'volume_name': 'volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edaaee4e-4805-4832-8b05-7b59b4c30240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edaaee4e-4805-4832-8b05-7b59b4c30240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51dc775-6f71-462c-bcd7-7af1dc543b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Volume dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e', 'volume_size': 1} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a86dd215-9a75-4d93-b852-c3f2a117b7c5,created_at=2026-09-25T09:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1253662255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a86dd215-9a75-4d93-b852-c3f2a117b7c5,host='devstack@QuobyteHD#QuobyteHD',id=dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c00a00ea46bbaa17f7bff9209816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:32Z,use_quota=True,user_id='e001582fc82e43fc967440cd174ada76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69ef6e2-b0f7-43ed-a920-94c172b9ead7),volume_type_id=d69ef6e2-b0f7-43ed-a920-94c172b9ead7)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Creating volume dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:31 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-8a34286d-51b5-412c-bfca-c190c0cb86ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.106s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:31 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e 1073741824 Sep 25 11:41:31 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-322d4243-eb61-4cbb-8fc7-4f6f0446e054 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-2c4dfbfc-82d2-4554-a599-fa599c48623a-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-8a34286d-51b5-412c-bfca-c190c0cb86ea" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-8a34286d-51b5-412c-bfca-c190c0cb86ea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Deleting offline snapshot 8a34286d-51b5-412c-bfca-c190c0cb86ea of volume e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] snapshot_file for this snap is: volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd2a145-6c4e-4ccd-85c3-7ac7a5a04aab]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:32 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea Sep 25 11:41:32 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-5921686c-a679-421c-8368-cacda6f96723-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-5921686c-a679-421c-8368-cacda6f96723-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "cinder-quobyte-5921686c-a679-421c-8368-cacda6f96723" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-5921686c-a679-421c-8368-cacda6f96723" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4dc9cd-1fad-45dc-8b09-33fd5c409344]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:32 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e 1073741824" returned: 0 in 0.763s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:32 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 Sep 25 11:41:32 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:32 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea" returned: 0 in 0.668s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e616fa-505b-4dda-96db-f262a7f8639a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:32 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e Sep 25 11:41:32 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:33 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 Sep 25 11:41:33 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:33 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723" returned: 0 in 0.536s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:33 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723 Sep 25 11:41:33 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:33 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" returned: 0 in 0.402s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51dc775-6f71-462c-bcd7-7af1dc543b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8163e1ec-88ad-4152-b8ae-0664f5c5029a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:33 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Volume volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e (dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e): created successfully Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8163e1ec-88ad-4152-b8ae-0664f5c5029a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Flow 'volume_create_manager' (81791402-30a0-434c-8a85-ae55ddd68669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:33 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d7e76c24-a4cb-4726-ab89-8c343f14606e tempest-GroupSnapshotsTest-1613358976 None] Created volume successfully. Sep 25 11:41:33 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5921686c-a679-421c-8368-cacda6f96723" returned: 0 in 0.288s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-quobyte-5921686c-a679-421c-8368-cacda6f96723" released by "delete_volume" :: held 0.894s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:33 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" returned: 0 in 0.676s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Created reservations ['42f78383-1baa-4666-8a69-de379188551a', '18e3f583-f220-48ef-ad1c-3b3b55026c6a', 'eeb34a4d-3ae5-4757-90a8-3a2707809008', '025448ad-6ea4-4246-bec2-f7d738723c7c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:33 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea Sep 25 11:41:33 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:33 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:33 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:33 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.282s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:33 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Deleted volume successfully. Sep 25 11:41:33 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4dbef45c-bb4d-4d47-a6b9-011d0892fc03 tempest-CreateVolumesFromSourceVolumeTest-460870767 None] Lock "cinder-5921686c-a679-421c-8368-cacda6f96723-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea" returned: 0 in 0.435s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:33 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea Sep 25 11:41:33 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:34 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891.8a34286d-51b5-412c-bfca-c190c0cb86ea" returned: 0 in 0.283s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-8a34286d-51b5-412c-bfca-c190c0cb86ea" released by "_delete_snapshot" :: held 2.245s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" released by "delete_snapshot" :: held 2.287s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-39aa148e-9988-4f90-bea6-8fe4fcd44c46 tempest-GroupSnapshotsTest-1613358976 None] Update group completed successfully. Sep 25 11:41:34 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Created reservations ['fcee0ca9-1db4-470a-be10-74d414561269', '264ef38d-c1f3-4dd3-8b75-e94e0fdb168d', 'c66373d8-4037-42d3-86f2-05e240afba53', '4194b22e-36c6-4f62-a291-c61c3c8e68bc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Delete snapshot completed successfully. Sep 25 11:41:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d21e03dd-08bb-4928-a489-c1370063f69a tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-8a34286d-51b5-412c-bfca-c190c0cb86ea-delete_snapshot" released by "delete_snapshot" :: held 2.517s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-e0fa3057-d7a2-42ff-99f9-05b7e6b80891-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-e0fa3057-d7a2-42ff-99f9-05b7e6b80891-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:35 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d833c49-f745-4adf-aad0-68a3eb8fb828]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:35 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 Sep 25 11:41:35 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:35 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1c9f8528-37e3-4e4f-91f6-0dd98fd2a4c5 tempest-GroupSnapshotsTest-1613358976 None] Update group completed successfully. Sep 25 11:41:35 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" returned: 0 in 0.484s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:35 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891 Sep 25 11:41:35 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:36 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" returned: 0 in 0.266s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-e0fa3057-d7a2-42ff-99f9-05b7e6b80891" released by "delete_volume" :: held 0.863s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Created reservations ['8f21f897-f7fc-495c-850b-50828074e108', '65ba18b5-b67b-4d84-ab89-3aa5a79da470', 'f13790d4-4356-4bb1-b3a2-f808b460d28d', '0afb8ed7-a72c-4d17-9a63-84ef23c0bb48'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:36 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:36 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-d4838228-17d1-4789-abef-b54d5d4a52a2-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-d4838228-17d1-4789-abef-b54d5d4a52a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "cinder-quobyte-d4838228-17d1-4789-abef-b54d5d4a52a2" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-d4838228-17d1-4789-abef-b54d5d4a52a2" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fef70aa-13d2-409a-a00e-3ee0f36191e9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:36 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.370s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Deleted volume successfully. Sep 25 11:41:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-93211a3d-3280-4c73-9cda-1564abfd3a48 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-e0fa3057-d7a2-42ff-99f9-05b7e6b80891-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-315e1cb3-06ec-4ddf-93f9-bcbb0e71f8e9 tempest-GroupSnapshotsTest-1613358976 None] Update group completed successfully. Sep 25 11:41:36 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 Sep 25 11:41:36 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:37 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2" returned: 0 in 0.431s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:37 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2 Sep 25 11:41:37 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:37 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d4838228-17d1-4789-abef-b54d5d4a52a2" returned: 0 in 0.284s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-quobyte-d4838228-17d1-4789-abef-b54d5d4a52a2" released by "delete_volume" :: held 0.831s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Created reservations ['19c9a1ef-6ed9-4d59-94c0-81a2fcd9618d', '88d12217-f257-42a5-8c20-be69263766de', 'f9ef128c-8b20-43f7-8821-09e008a1d85c', 'e5d03958-90ec-4043-8925-236ad11763fc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:37 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:37 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:38 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.338s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:38 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:38 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Deleted volume successfully. Sep 25 11:41:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fdc4a7b6-8f41-4b1e-96c5-19cb94744871 tempest-VolumesSnapshotTestJSON-830189143 None] Lock "cinder-d4838228-17d1-4789-abef-b54d5d4a52a2-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:38 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1dbcad32-1865-4fa8-8d19-d728d7e29a0e tempest-GroupSnapshotsTest-1613358976 None] Update group completed successfully. Sep 25 11:41:39 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] GroupSnapshot 2bf664aa-4c3a-4aa5-a2b6-1bcf02ada3ad: creating. Sep 25 11:41:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Group snapshot 2bf664aa-4c3a-4aa5-a2b6-1bcf02ada3ad: creating. {{(pid=87356) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 11:41:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Creating offline snapshot 5bd77862-22fb-4dac-99f2-d06e2529b80d of volume dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:41:40 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8813f8d3-3721-4c54-8ad5-70c3e990af15]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:40 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e Sep 25 11:41:40 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:40 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" returned: 0 in 0.624s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:40 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d 1G Sep 25 11:41:40 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:41 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d 1G" returned: 0 in 0.650s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:41 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d Sep 25 11:41:41 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:41 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d" returned: 0 in 0.451s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:41 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:41:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:41 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d Sep 25 11:41:41 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Flow 'volume_create_manager' (fdbdb820-d6a4-46ad-b5b5-584eb802292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e75135a-3e35-4ea8-89ad-2efc1633c5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:42 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d" returned: 0 in 0.299s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e75135a-3e35-4ea8-89ad-2efc1633c5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079da45e-a410-4123-aeba-63c3b1bacd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4020276f59084c87b21ebebfaaf5c2d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:42Z,use_quota=True,user_id='012968de84fa4e43b1ec3a1c2fa4a336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93d8a0c-a779-4791-895f-07575e9ee12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93d8a0c-a779-4791-895f-07575e9ee12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1c9b5f-7c12-4aab-89e9-da95e3f30525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:42 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.info Sep 25 11:41:42 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1c9b5f-7c12-4aab-89e9-da95e3f30525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '079da45e-a410-4123-aeba-63c3b1bacd56', 'volume_name': 'volume-079da45e-a410-4123-aeba-63c3b1bacd56', 'volume_size': 1, 'image_id': 'a52917d4-a594-4706-b3d7-924883e5680f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a52917d4-a594-4706-b3d7-924883e5680f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '873884840540fdf54136f4d3c15c2818', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4020276f59084c87b21ebebfaaf5c2d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f09926f614c42cfb3db4d9c67b45448a6fc8643e43eb3603de13b2d4aafcdff12d64b4bd7f82f935bc6f255262da4f9e5107e2e1c920c7e4780fa10ec5f0761c', 'id': 'a52917d4-a594-4706-b3d7-924883e5680f', 'created_at': datetime.datetime(2026, 9, 25, 9, 41, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 41, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a52917d4-a594-4706-b3d7-924883e5680f/file', 'properties': {}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f9e1ca-d758-40bf-86fa-5b5b6f250cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f9e1ca-d758-40bf-86fa-5b5b6f250cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:42 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c18a4d1-18aa-49a9-895b-8e526be774c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Volume 079da45e-a410-4123-aeba-63c3b1bacd56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-079da45e-a410-4123-aeba-63c3b1bacd56', 'volume_size': 1, 'image_id': 'a52917d4-a594-4706-b3d7-924883e5680f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a52917d4-a594-4706-b3d7-924883e5680f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '873884840540fdf54136f4d3c15c2818', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4020276f59084c87b21ebebfaaf5c2d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f09926f614c42cfb3db4d9c67b45448a6fc8643e43eb3603de13b2d4aafcdff12d64b4bd7f82f935bc6f255262da4f9e5107e2e1c920c7e4780fa10ec5f0761c', 'id': 'a52917d4-a594-4706-b3d7-924883e5680f', 'created_at': datetime.datetime(2026, 9, 25, 9, 41, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 41, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a52917d4-a594-4706-b3d7-924883e5680f/file', 'properties': {}}, 'image_service': } Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Trying to clone 079da45e-a410-4123-aeba-63c3b1bacd56 from image a52917d4-a594-4706-b3d7-924883e5680f at location (None, [{'url': 'file:///opt/stack/data/glance/images/a52917d4-a594-4706-b3d7-924883e5680f', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.info" returned: 0 in 0.320s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:42 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:42 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.info Sep 25 11:41:42 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:41:42 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Image download 0.00 MB at 0.00 MB/s Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d531f8-43cc-4cd8-9309-71aa0946c835]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:42 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.info" returned: 0 in 0.376s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.882s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:42 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD Sep 25 11:41:42 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Creating offline snapshot b20a2517-551c-4b7d-a28f-01d825a63745 of volume bb46a049-98fe-4f25-b060-db0b6b635452 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4fc5ff-40cb-479d-b751-0ceea44cfecc]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:43 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 Sep 25 11:41:43 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:43 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:43 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD Sep 25 11:41:43 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:43 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452" returned: 0 in 0.531s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:43 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 1G Sep 25 11:41:43 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:43 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD" returned: 1 in 0.490s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Temporary image a52917d4-a594-4706-b3d7-924883e5680f is fetched for user 012968de84fa4e43b1ec3a1c2fa4a336. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2ea6e2-1c5b-4a46-a6f4-300a34f48193]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:43 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD Sep 25 11:41:43 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:43 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 1G" returned: 0 in 0.537s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb46a049-98fe-4f25-b060-db0b6b635452 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:44 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb46a049-98fe-4f25-b060-db0b6b635452 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 Sep 25 11:41:44 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:44 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:44 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD Sep 25 11:41:44 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:44 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb46a049-98fe-4f25-b060-db0b6b635452 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745" returned: 0 in 0.453s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:44 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:44 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 Sep 25 11:41:44 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:44 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:44 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745" returned: 0 in 0.296s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:44 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.info Sep 25 11:41:44 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:45 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.info" returned: 0 in 0.280s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:45 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:45 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.info Sep 25 11:41:45 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:45 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.info" returned: 0 in 0.323s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079da45e-a410-4123-aeba-63c3b1bacd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4020276f59084c87b21ebebfaaf5c2d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:42Z,use_quota=True,user_id='012968de84fa4e43b1ec3a1c2fa4a336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Creating volume 079da45e-a410-4123-aeba-63c3b1bacd56 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:45 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:45 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 1073741824 Sep 25 11:41:45 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-171f2cdb-26d3-445a-909e-b21162590af5 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 2bf664aa-4c3a-4aa5-a2b6-1bcf02ada3ad: created successfully Sep 25 11:41:46 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 1073741824" returned: 0 in 0.613s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:46 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 Sep 25 11:41:46 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:46 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56" returned: 0 in 0.450s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Attempting download of a52917d4-a594-4706-b3d7-924883e5680f ((None, [{'url': 'file:///opt/stack/data/glance/images/a52917d4-a594-4706-b3d7-924883e5680f', 'metadata': {}}])) to volume 079da45e-a410-4123-aeba-63c3b1bacd56. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Flow 'volume_create_manager' (0a52753b-90b8-4bbb-964b-8787f9766f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e3c0b8-91db-40ee-95d4-0d611254aacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:46 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 2bf664aa-4c3a-4aa5-a2b6-1bcf02ada3ad: deleting Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e3c0b8-91db-40ee-95d4-0d611254aacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-678051279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6310c049-7b05-4e9d-ba98-bdbb187e348c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939724f79f144e22b382fa62d47adf34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:47Z,use_quota=True,user_id='f78b92347afe49d8af6884b386feb4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff35397-ea76-4e3e-862a-bc6f6fcca504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff35397-ea76-4e3e-862a-bc6f6fcca504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd5e743-1230-4789-8605-20b979398812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd5e743-1230-4789-8605-20b979398812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6310c049-7b05-4e9d-ba98-bdbb187e348c', 'volume_name': 'volume-6310c049-7b05-4e9d-ba98-bdbb187e348c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f147d656-f048-4652-bdf2-efcb6222d669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f147d656-f048-4652-bdf2-efcb6222d669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de08ba1-d87a-4608-b2b0-738d54cd1ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:46 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Volume 6310c049-7b05-4e9d-ba98-bdbb187e348c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6310c049-7b05-4e9d-ba98-bdbb187e348c', 'volume_size': 1} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-678051279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6310c049-7b05-4e9d-ba98-bdbb187e348c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939724f79f144e22b382fa62d47adf34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:47Z,use_quota=True,user_id='f78b92347afe49d8af6884b386feb4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Creating volume 6310c049-7b05-4e9d-ba98-bdbb187e348c {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:46 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1727c33-ae4e-4ce7-a3fe-1f7ee548c6fc]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a52917d4-a594-4706-b3d7-924883e5680f_d5rgm4ta {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:46 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c 1073741824 Sep 25 11:41:46 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 2bf664aa-4c3a-4aa5-a2b6-1bcf02ada3ad: deleting {{(pid=87356) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-5bd77862-22fb-4dac-99f2-d06e2529b80d" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-5bd77862-22fb-4dac-99f2-d06e2529b80d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Deleting offline snapshot 5bd77862-22fb-4dac-99f2-d06e2529b80d of volume dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:41:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] snapshot_file for this snap is: volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:41:46 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a52917d4-a594-4706-b3d7-924883e5680f_d5rgm4ta Sep 25 11:41:47 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcfa4b3-1ae8-45cf-979b-0864bfb7cd2c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:47 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d Sep 25 11:41:47 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:47 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a52917d4-a594-4706-b3d7-924883e5680f_d5rgm4ta" returned: 0 in 0.545s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a52917d4-a594-4706-b3d7-924883e5680f_d5rgm4ta {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:47 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c 1073741824" returned: 0 in 0.692s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:47 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a52917d4-a594-4706-b3d7-924883e5680f_d5rgm4ta Sep 25 11:41:47 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:47 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d" returned: 0 in 0.535s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dac3d8d-bb70-4659-a9c7-12824bd55d2f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:47 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c Sep 25 11:41:47 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:47 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e Sep 25 11:41:47 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:47 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a52917d4-a594-4706-b3d7-924883e5680f_d5rgm4ta" returned: 1 in 0.485s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a52917d4-a594-4706-b3d7-924883e5680f_d5rgm4ta' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb46853-f9e1-4821-938a-fd01e5016cb3]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:47 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c" returned: 0 in 0.375s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:47 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:47 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de08ba1-d87a-4608-b2b0-738d54cd1ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6310c049-7b05-4e9d-ba98-bdbb187e348c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265fceb9-cb6a-4ab7-a226-30ad2c0473d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:48 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Volume volume-6310c049-7b05-4e9d-ba98-bdbb187e348c (6310c049-7b05-4e9d-ba98-bdbb187e348c): created successfully Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265fceb9-cb6a-4ab7-a226-30ad2c0473d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Flow 'volume_create_manager' (0a52753b-90b8-4bbb-964b-8787f9766f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:48 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-846a8f5b-85a3-4737-a844-bb6f49ce9a3a tempest-AttachVolumeNegativeTest-1071383120 None] Created volume successfully. Sep 25 11:41:48 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" returned: 0 in 0.547s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:48 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d Sep 25 11:41:48 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:48 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:48 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD Sep 25 11:41:48 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:48 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d" returned: 0 in 0.431s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:48 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d Sep 25 11:41:48 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] a52917d4-a594-4706-b3d7-924883e5680f was raw, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:41:48 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:48 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 Sep 25 11:41:48 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:49 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e.5bd77862-22fb-4dac-99f2-d06e2529b80d" returned: 0 in 0.430s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-5bd77862-22fb-4dac-99f2-d06e2529b80d" released by "_delete_snapshot" :: held 2.161s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" released by "delete_snapshot" :: held 2.201s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Flow 'volume_create_manager' (8a26b96c-40ce-4ba1-ba4e-ab8abe4c917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dacc08-a777-472a-90d6-5138bd05c64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-bb46a049-98fe-4f25-b060-db0b6b635452" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dacc08-a777-472a-90d6-5138bd05c64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-557904557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3124eb-b7cd-4330-8c05-b2c67313d29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cdef8ca10549fc9911e359b6222f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:49Z,use_quota=True,user_id='15a2927dc6ef41788701233258df8f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca4f8bf-d55f-41ea-ba9e-2b506ddfebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca4f8bf-d55f-41ea-ba9e-2b506ddfebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f88ca7-b4ef-418e-b44d-9ab1069baeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f88ca7-b4ef-418e-b44d-9ab1069baeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3124eb-b7cd-4330-8c05-b2c67313d29e', 'volume_name': 'volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e', 'volume_size': 2}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a81ab7-0ea1-4832-a2d2-5c11ab62f7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a81ab7-0ea1-4832-a2d2-5c11ab62f7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca01ea8a-9971-4663-a667-5951276a6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Volume 2a3124eb-b7cd-4330-8c05-b2c67313d29e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e', 'volume_size': 2} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-557904557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3124eb-b7cd-4330-8c05-b2c67313d29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cdef8ca10549fc9911e359b6222f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:49Z,use_quota=True,user_id='15a2927dc6ef41788701233258df8f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Creating volume 2a3124eb-b7cd-4330-8c05-b2c67313d29e {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:49 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e 2147483648 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:49 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e 2147483648 Sep 25 11:41:49 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-bb46a049-98fe-4f25-b060-db0b6b635452" acquired by "delete_snapshot" :: waited 0.132s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-b20a2517-551c-4b7d-a28f-01d825a63745" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-b20a2517-551c-4b7d-a28f-01d825a63745" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Deleting offline snapshot b20a2517-551c-4b7d-a28f-01d825a63745 of volume bb46a049-98fe-4f25-b060-db0b6b635452 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] snapshot_file for this snap is: volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8cdad-af38-47da-83f7-7642a4f6e93a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:49 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56" returned: 0 in 0.706s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a52917d4-a594-4706-b3d7-924883e5680f_9buhl5a1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:41:49 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:49 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 1G Sep 25 11:41:49 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:49 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 Sep 25 11:41:49 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-bb4051a0-539f-4466-b757-3490d1495cfe req-ceff02dd-15d3-4466-af0e-ac61eae2b14b tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:49 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:49 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 1G" returned: 0 in 0.477s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Downloaded image a52917d4-a594-4706-b3d7-924883e5680f ((None, [{'url': 'file:///opt/stack/data/glance/images/a52917d4-a594-4706-b3d7-924883e5680f', 'metadata': {}}])) to volume 079da45e-a410-4123-aeba-63c3b1bacd56 successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Temporary image a52917d4-a594-4706-b3d7-924883e5680f for user 012968de84fa4e43b1ec3a1c2fa4a336 is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:41:49 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Marking volume 079da45e-a410-4123-aeba-63c3b1bacd56 as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e 2147483648" returned: 0 in 0.763s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Copying metadata from image a52917d4-a594-4706-b3d7-924883e5680f to 079da45e-a410-4123-aeba-63c3b1bacd56. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Creating volume glance metadata for volume 079da45e-a410-4123-aeba-63c3b1bacd56 backed by image a52917d4-a594-4706-b3d7-924883e5680f with: {'image_id': 'a52917d4-a594-4706-b3d7-924883e5680f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '873884840540fdf54136f4d3c15c2818', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:41:50 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745" returned: 0 in 0.655s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb46a049-98fe-4f25-b060-db0b6b635452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ae235e-2f1c-4045-b1a6-181de82d6f60]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:50 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e Sep 25 11:41:50 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c18a4d1-18aa-49a9-895b-8e526be774c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079da45e-a410-4123-aeba-63c3b1bacd56', 'volume_size': 1, 'image_id': 'a52917d4-a594-4706-b3d7-924883e5680f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a52917d4-a594-4706-b3d7-924883e5680f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '873884840540fdf54136f4d3c15c2818', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4020276f59084c87b21ebebfaaf5c2d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f09926f614c42cfb3db4d9c67b45448a6fc8643e43eb3603de13b2d4aafcdff12d64b4bd7f82f935bc6f255262da4f9e5107e2e1c920c7e4780fa10ec5f0761c', 'id': 'a52917d4-a594-4706-b3d7-924883e5680f', 'created_at': datetime.datetime(2026, 9, 25, 9, 41, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 41, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a52917d4-a594-4706-b3d7-924883e5680f/file', 'properties': {}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7adf379-4c48-498f-8aba-9c670a04d61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:50 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 Sep 25 11:41:50 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:50 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Volume volume-079da45e-a410-4123-aeba-63c3b1bacd56 (079da45e-a410-4123-aeba-63c3b1bacd56): created successfully Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7adf379-4c48-498f-8aba-9c670a04d61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Flow 'volume_create_manager' (fdbdb820-d6a4-46ad-b5b5-584eb802292c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-72fcc19d-2109-4a7b-9452-f6c22c8f3c97 tempest-VolumeImageDependencyTests-1695242927 None] Created volume successfully. Sep 25 11:41:50 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e" returned: 0 in 0.314s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-bb4051a0-539f-4466-b757-3490d1495cfe req-ceff02dd-15d3-4466-af0e-ac61eae2b14b tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.413s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca01ea8a-9971-4663-a667-5951276a6965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e', 'volume_size': 2}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d46072-0180-4223-8fa8-b19a43b6285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-bb4051a0-539f-4466-b757-3490d1495cfe req-ceff02dd-15d3-4466-af0e-ac61eae2b14b tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:50 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Volume volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e (2a3124eb-b7cd-4330-8c05-b2c67313d29e): created successfully Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d46072-0180-4223-8fa8-b19a43b6285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Flow 'volume_create_manager' (8a26b96c-40ce-4ba1-ba4e-ab8abe4c917b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-cbc346e4-0619-42c7-ba7a-bfdb73599a79 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Created volume successfully. Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-bb4051a0-539f-4466-b757-3490d1495cfe req-ceff02dd-15d3-4466-af0e-ac61eae2b14b tempest-AttachVolumeNegativeTest-1071383120 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-6310c049-7b05-4e9d-ba98-bdbb187e348c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b5dafae-5c6e-4c76-bd81-4151248c7e28', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:41:50 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452" returned: 0 in 0.488s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:50 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 Sep 25 11:41:50 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-bb4051a0-539f-4466-b757-3490d1495cfe req-ceff02dd-15d3-4466-af0e-ac61eae2b14b tempest-AttachVolumeNegativeTest-1071383120 None] attachment_update completed successfully. Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Acquiring lock "cinder-079da45e-a410-4123-aeba-63c3b1bacd56-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Lock "cinder-079da45e-a410-4123-aeba-63c3b1bacd56-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Acquiring lock "cinder-quobyte-079da45e-a410-4123-aeba-63c3b1bacd56" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Lock "cinder-quobyte-079da45e-a410-4123-aeba-63c3b1bacd56" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b997104-cee7-4732-add8-01959697ea36]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:51 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745" returned: 0 in 0.461s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:51 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 Sep 25 11:41:51 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:51 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745 Sep 25 11:41:51 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:51 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:51 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56" returned: 0 in 0.632s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452.b20a2517-551c-4b7d-a28f-01d825a63745" returned: 0 in 0.502s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:51 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56 Sep 25 11:41:51 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-b20a2517-551c-4b7d-a28f-01d825a63745" released by "_delete_snapshot" :: held 2.276s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-bb46a049-98fe-4f25-b060-db0b6b635452" released by "delete_snapshot" :: held 2.333s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Creating offline snapshot b557dcae-ba7c-4ec9-9451-b41a0bf78982 of volume 2a3124eb-b7cd-4330-8c05-b2c67313d29e {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd0b910-ba89-43fb-8d85-855140b65fe3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:51 devstack cinder-volume[87356]: WARNING cinder.quota [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1230094025 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1230094025, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:41:51 devstack cinder-volume[87356]: WARNING cinder.quota [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1230094025 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1230094025, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:41:51 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['13aa682d-f4cd-47d6-90b6-46c8d4cfb221', 'e8f287e9-0e0d-409b-87ca-1bf5774c8329', '7492699e-490e-4d15-875c-fedd27a31cca', 'a6fd002d-4e4e-401a-956c-8510a0d95655'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:51 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e Sep 25 11:41:51 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:51 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-079da45e-a410-4123-aeba-63c3b1bacd56" returned: 0 in 0.461s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Lock "cinder-quobyte-079da45e-a410-4123-aeba-63c3b1bacd56" released by "delete_volume" :: held 1.156s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Created reservations ['5320db8e-cf46-4396-8fc3-0e1b4b38c10c', 'db155600-683d-48c9-80fe-b7be7d6954d9', '4abbe8b3-2a5b-49ba-bd3f-661878eb6957', '900d6f1a-3228-4c8b-b0eb-141893bb28ce'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['02e97421-6eb5-4439-aa47-6aa7c65f4a40', 'dff1fedf-97c9-4301-bee7-4ad8885bf9e0', '1b15f21c-fc81-47ef-9451-70bbd072a6b9', 'bbeb73be-ca18-439a-a00d-30c650266b4d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6e5466fe-4738-4075-b078-b1be7b3fcd64 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 2bf664aa-4c3a-4aa5-a2b6-1bcf02ada3ad: deleted successfully Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:52 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:52 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:52 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e" returned: 0 in 0.580s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 2G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:52 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 2G Sep 25 11:41:52 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:52 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.373s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Deleted volume successfully. Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-533407c8-0b54-4ced-bf3d-b03c586ea0ce tempest-VolumeImageDependencyTests-1695242927 None] Lock "cinder-079da45e-a410-4123-aeba-63c3b1bacd56-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-bb46a049-98fe-4f25-b060-db0b6b635452" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-bb46a049-98fe-4f25-b060-db0b6b635452" acquired by "delete_volume" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:52 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 2G" returned: 0 in 0.612s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc02ef0-dd58-44f0-ac4b-5e165e0ec7f0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:52 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 Sep 25 11:41:52 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:53 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 Sep 25 11:41:53 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:53 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982" returned: 0 in 0.513s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:53 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 is being set with open permissions: ugo+rw Sep 25 11:41:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:53 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 Sep 25 11:41:53 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:53 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452" returned: 0 in 0.651s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:53 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452 Sep 25 11:41:53 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:53 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982" returned: 0 in 0.397s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:53 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.info Sep 25 11:41:53 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:53 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bb46a049-98fe-4f25-b060-db0b6b635452" returned: 0 in 0.403s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-bb46a049-98fe-4f25-b060-db0b6b635452" released by "delete_volume" :: held 1.149s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acfafef-0f31-4674-bfa4-ec16a6157fa8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:54 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.info" returned: 0 in 0.388s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:54 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.info is being set with open permissions: ugo+rw Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:54 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.info Sep 25 11:41:54 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:54 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e Sep 25 11:41:54 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:54 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.info" returned: 0 in 0.393s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.069s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=164,cinder:UPDATE=189,cinder:DELETE=10,cinder:INSERT=48 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:41:54 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" returned: 0 in 0.594s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:54 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e Sep 25 11:41:54 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fb6af7e2-c4a7-470f-8b65-6c126cd35a14 tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Create snapshot completed successfully Sep 25 11:41:55 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" returned: 0 in 0.316s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-dc46ca52-edfb-4eea-a857-1c1b1bf4fe1e" released by "delete_volume" :: held 1.028s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['11a11ac5-0a31-4d8e-8703-e8b81d922c22'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:55 devstack cinder-volume[87356]: WARNING cinder.quota [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1230094025 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1230094025, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['302eea2b-1161-416e-8bc7-8de32fbec174', '2d810400-28c4-4e36-b2d6-6937947536da', 'a9afceb6-1daa-4d3c-b96f-bf5e4dbb84ac', 'c569255b-5690-4cfa-825f-1190ae183604'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['728b7bb5-fc63-4ff0-a155-92de32b2315f', 'f92a653d-fe0a-4551-818b-0b80689bbde7', '6f15a71c-febc-47b7-9d61-debb620564c2', 'e1641980-a2e3-423e-b62e-35f0075daab3'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:55 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:41:55 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "cinder-b557dcae-ba7c-4ec9-9451-b41a0bf78982-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-b557dcae-ba7c-4ec9-9451-b41a0bf78982-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "cinder-quobyte-2a3124eb-b7cd-4330-8c05-b2c67313d29e" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-quobyte-2a3124eb-b7cd-4330-8c05-b2c67313d29e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "cinder-quobyte-b557dcae-ba7c-4ec9-9451-b41a0bf78982" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:56 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.394s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-quobyte-b557dcae-ba7c-4ec9-9451-b41a0bf78982" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Deleting offline snapshot b557dcae-ba7c-4ec9-9451-b41a0bf78982 of volume 2a3124eb-b7cd-4330-8c05-b2c67313d29e {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] snapshot_file for this snap is: volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:41:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d1b6844b-a586-4f56-a38d-85f48cf1f668 tempest-GroupSnapshotsTest-1613358976 None] Delete group completed successfully. Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a307f82-64f4-4359-ae77-1007a4ebc714]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:56 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 Sep 25 11:41:56 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:56 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982" returned: 0 in 0.448s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c18370-2c08-43cb-9259-5cca568de88e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:56 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e Sep 25 11:41:56 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:57 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e" returned: 0 in 0.501s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:57 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 Sep 25 11:41:57 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:57 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=167,cinder:INSERT=47,cinder:UPDATE=198,cinder:DELETE=16 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:41:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8e8dc2b4-baf2-4ec0-851e-f09f41f5f86e tempest-GroupSnapshotsTest-1613358976 None] Group tempest-GroupSnapshotsTest-Group-2143258159: creating Sep 25 11:41:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8e8dc2b4-baf2-4ec0-851e-f09f41f5f86e tempest-GroupSnapshotsTest-1613358976 None] Group tempest-GroupSnapshotsTest-Group-2143258159: created successfully Sep 25 11:41:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8e8dc2b4-baf2-4ec0-851e-f09f41f5f86e tempest-GroupSnapshotsTest-1613358976 None] Create group completed successfully. Sep 25 11:41:57 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982" returned: 0 in 0.480s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:57 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982 Sep 25 11:41:57 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:58 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e.b557dcae-ba7c-4ec9-9451-b41a0bf78982" returned: 0 in 0.390s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-quobyte-b557dcae-ba7c-4ec9-9451-b41a0bf78982" released by "_delete_snapshot" :: held 2.019s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-quobyte-2a3124eb-b7cd-4330-8c05-b2c67313d29e" released by "delete_snapshot" :: held 2.053s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:58 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Created reservations ['fd8211fe-fe90-4c4b-ac2b-9528c1809628', '8f7bc777-0f8a-4f9d-b075-9364b8f045ff', '30dcd0dd-7fbf-494e-9e03-61672e1bed68', '3b32d61d-150f-44e6-b02a-28ce1dc774e3'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:41:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Delete snapshot completed successfully. Sep 25 11:41:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4bede55f-b2ac-4061-9310-4fe41151e6ec tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-b557dcae-ba7c-4ec9-9451-b41a0bf78982-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Flow 'volume_create_manager' (521ad281-0dd4-4ae9-802d-77069d82b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9227a30c-2146-473e-810b-63d9a39486e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9227a30c-2146-473e-810b-63d9a39486e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1879885428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca142625-d584-4ab0-bdaf-f94010f3067b,host='devstack@QuobyteHD#QuobyteHD',id=c948d2ac-0ce0-4bbf-9e67-4869a2fc352b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c00a00ea46bbaa17f7bff9209816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:59Z,use_quota=True,user_id='e001582fc82e43fc967440cd174ada76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1662c043-5a67-481b-9942-0be8aeef77a4),volume_type_id=1662c043-5a67-481b-9942-0be8aeef77a4)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b094950a-5537-46ed-b22d-501c30c4690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b094950a-5537-46ed-b22d-501c30c4690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2d0bdf-e34f-4d80-8073-932f515cf65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2d0bdf-e34f-4d80-8073-932f515cf65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c948d2ac-0ce0-4bbf-9e67-4869a2fc352b', 'volume_name': 'volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011c3939-65c8-4a92-97d0-c5034bcb1ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011c3939-65c8-4a92-97d0-c5034bcb1ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da08fb9d-d3e6-4aef-9814-903a17c7f3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:59 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Volume c948d2ac-0ce0-4bbf-9e67-4869a2fc352b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b', 'volume_size': 1} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca142625-d584-4ab0-bdaf-f94010f3067b,created_at=2026-09-25T09:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1879885428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca142625-d584-4ab0-bdaf-f94010f3067b,host='devstack@QuobyteHD#QuobyteHD',id=c948d2ac-0ce0-4bbf-9e67-4869a2fc352b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c00a00ea46bbaa17f7bff9209816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:59Z,use_quota=True,user_id='e001582fc82e43fc967440cd174ada76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1662c043-5a67-481b-9942-0be8aeef77a4),volume_type_id=1662c043-5a67-481b-9942-0be8aeef77a4)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Creating volume c948d2ac-0ce0-4bbf-9e67-4869a2fc352b {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:59 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:59 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b 1073741824 Sep 25 11:41:59 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "cinder-2a3124eb-b7cd-4330-8c05-b2c67313d29e-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-2a3124eb-b7cd-4330-8c05-b2c67313d29e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "cinder-quobyte-2a3124eb-b7cd-4330-8c05-b2c67313d29e" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-quobyte-2a3124eb-b7cd-4330-8c05-b2c67313d29e" acquired by "delete_volume" :: waited 0.041s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f6194c-36f5-4e2b-8de0-c9415e328123]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:41:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:59 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e Sep 25 11:41:59 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:00 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b 1073741824" returned: 0 in 0.649s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:00 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b Sep 25 11:42:00 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:00 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e" returned: 0 in 0.597s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:00 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e Sep 25 11:42:00 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:00 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" returned: 0 in 0.568s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da08fb9d-d3e6-4aef-9814-903a17c7f3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ee9d63-590c-43d5-9231-1dcbab990342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Volume volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b (c948d2ac-0ce0-4bbf-9e67-4869a2fc352b): created successfully Sep 25 11:42:00 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ee9d63-590c-43d5-9231-1dcbab990342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Flow 'volume_create_manager' (521ad281-0dd4-4ae9-802d-77069d82b110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2a3124eb-b7cd-4330-8c05-b2c67313d29e" returned: 0 in 0.499s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:00 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-quobyte-2a3124eb-b7cd-4330-8c05-b2c67313d29e" released by "delete_volume" :: held 1.222s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-72a2fe8e-9d6a-4e6d-88f3-4ea65d01531f tempest-GroupSnapshotsTest-1613358976 None] Created volume successfully. Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Created reservations ['174c15eb-a792-4b28-8d17-80e90557848b', '78196fc3-066e-4d38-b32b-83ff2a1c79cb', '356a63f2-48b5-4922-8fec-37b4d296081c', '71fc1c2c-7d34-419d-ae3b-a53e1f90c3fb'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:01 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:42:01 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:01 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.316s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:01 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Deleted volume successfully. Sep 25 11:42:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e2ad938-b941-4afd-8ddc-22f0ad19774a tempest-VolumesSnapshotNegativeTestJSON-398629644 None] Lock "cinder-2a3124eb-b7cd-4330-8c05-b2c67313d29e-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:02 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] GroupSnapshot 921372c5-b760-4d59-9199-f700db2518b2: creating. Sep 25 11:42:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Group snapshot 921372c5-b760-4d59-9199-f700db2518b2: creating. {{(pid=87356) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 11:42:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Creating offline snapshot 67a5c3d8-5443-4c87-9b98-a2237b0b0594 of volume c948d2ac-0ce0-4bbf-9e67-4869a2fc352b {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:42:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c964f8-87a5-491a-88fc-462b5394072a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:02 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b Sep 25 11:42:02 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:03 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" returned: 0 in 0.602s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:03 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 1G Sep 25 11:42:03 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:03 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 1G" returned: 0 in 0.586s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:03 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 Sep 25 11:42:03 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:04 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594" returned: 0 in 0.602s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:04 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:42:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:04 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 Sep 25 11:42:04 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:04 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594" returned: 0 in 0.555s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:05 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.info Sep 25 11:42:05 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:05 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.info" returned: 0 in 0.520s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:05 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:42:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:05 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.info Sep 25 11:42:05 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:05 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.info" returned: 0 in 0.321s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.329s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fbf51a2a-5b2b-4d9e-9b4a-9bb226b024ca tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 921372c5-b760-4d59-9199-f700db2518b2: created successfully Sep 25 11:42:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 921372c5-b760-4d59-9199-f700db2518b2: deleting Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 921372c5-b760-4d59-9199-f700db2518b2: deleting {{(pid=87356) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-67a5c3d8-5443-4c87-9b98-a2237b0b0594" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-67a5c3d8-5443-4c87-9b98-a2237b0b0594" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Deleting offline snapshot 67a5c3d8-5443-4c87-9b98-a2237b0b0594 of volume c948d2ac-0ce0-4bbf-9e67-4869a2fc352b {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] snapshot_file for this snap is: volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4fc7e1-efbb-40d9-b4f6-5821ddc1159a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:07 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 Sep 25 11:42:07 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:08 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594" returned: 0 in 0.677s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:42:08 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ff7de-fbb1-4d04-910b-af13cf88e3be]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:08 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b Sep 25 11:42:08 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:08 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" returned: 0 in 0.628s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:08 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 Sep 25 11:42:08 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:09 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594" returned: 0 in 0.733s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:09 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594 Sep 25 11:42:09 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:09 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b.67a5c3d8-5443-4c87-9b98-a2237b0b0594" returned: 0 in 0.484s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-67a5c3d8-5443-4c87-9b98-a2237b0b0594" released by "_delete_snapshot" :: held 2.758s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" released by "delete_snapshot" :: held 2.797s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:10 devstack cinder-volume[87356]: WARNING cinder.quota [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-291270392 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-291270392, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:42:10 devstack cinder-volume[87356]: WARNING cinder.quota [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-291270392 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-291270392, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:42:10 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['5e321bd6-e85a-4a19-aa21-c624242350f8', '21bd905f-e148-4730-b78b-f5d86f64616a', '8464f71a-d9bd-48a9-b6f0-130a64c80207', '6235c712-7c95-4774-8437-c4098e75056c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ffa086ed-50e5-4aed-a061-9155b86c1665 tempest-GroupSnapshotsTest-1613358976 None] group_snapshot 921372c5-b760-4d59-9199-f700db2518b2: deleted successfully Sep 25 11:42:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "cinder-quobyte-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e108ff7-0263-42c6-98eb-5c156a784cb2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:11 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b Sep 25 11:42:11 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:11 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" returned: 0 in 0.522s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:11 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b Sep 25 11:42:11 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:12 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" returned: 0 in 0.282s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Lock "cinder-quobyte-c948d2ac-0ce0-4bbf-9e67-4869a2fc352b" released by "delete_volume" :: held 0.906s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['02edd72c-8e33-4a51-9beb-0f4ec2c71d1d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:12 devstack cinder-volume[87356]: WARNING cinder.quota [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-291270392 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-291270392, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Created reservations ['0c3e3e7b-ebc1-4ce6-adbd-8227e2824a33', '3df35a3d-8bd4-4356-9048-185ebd5b2683', '9310ad4b-cff9-47c2-a62b-a3124cceae8d', 'e36e52e3-c2b2-4e0b-90c3-d6cca0c57df4'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:12 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:42:12 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:13 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.421s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:13 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5216001a-b88a-4a0f-9566-e438b4f3fc2a tempest-GroupSnapshotsTest-1613358976 None] Delete group completed successfully. Sep 25 11:42:22 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=59,cinder:UPDATE=56,cinder:INSERT=14 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:42:22 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=38,cinder:SELECT=24,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:23 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:42:23 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:23 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-32f4d68f-43f3-4780-8828-be8dad081f30 tempest-GroupsV320Test-1250381467 None] Group tempest-GroupsV320Test-Group-890276331: creating Sep 25 11:42:23 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-32f4d68f-43f3-4780-8828-be8dad081f30 tempest-GroupsV320Test-1250381467 None] Group tempest-GroupsV320Test-Group-890276331: created successfully Sep 25 11:42:23 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-32f4d68f-43f3-4780-8828-be8dad081f30 tempest-GroupsV320Test-1250381467 None] Create group completed successfully. Sep 25 11:42:23 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.417s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:42:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Created reservations ['0d75f10a-8236-4978-9d7b-24c11b6d2fef'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:25 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:42:25 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:25 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.306s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:25 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-31dfc6e9-c5df-41bc-afad-8ef86e7ed66c tempest-GroupsV320Test-1250381467 None] Delete group completed successfully. Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Flow 'volume_create_manager' (60d5cf48-1dd2-465e-8e74-16c73f4add7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104ce27f-3725-4d23-91e2-25b2180103e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104ce27f-3725-4d23-91e2-25b2180103e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-620426731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bdbfc69-804b-4b17-a95e-e52a06d835b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae372b5b6cc4f438a5025746010ff30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:36Z,use_quota=True,user_id='737e48175fe049108c304f4a84b88695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcdba10-96b5-49a1-9f37-5eb5ea32b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcdba10-96b5-49a1-9f37-5eb5ea32b65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf294b8-80d6-42a9-b043-a6c720bf543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf294b8-80d6-42a9-b043-a6c720bf543a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bdbfc69-804b-4b17-a95e-e52a06d835b7', 'volume_name': 'volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c2886e-b16b-4ec0-8c79-be04042c47e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c2886e-b16b-4ec0-8c79-be04042c47e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d816f4-0567-48be-a622-2dd8f1b02442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:35 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Volume 0bdbfc69-804b-4b17-a95e-e52a06d835b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7', 'volume_size': 1} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-620426731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bdbfc69-804b-4b17-a95e-e52a06d835b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae372b5b6cc4f438a5025746010ff30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:36Z,use_quota=True,user_id='737e48175fe049108c304f4a84b88695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Creating volume 0bdbfc69-804b-4b17-a95e-e52a06d835b7 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:35 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:42:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:35 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 1073741824 Sep 25 11:42:35 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-6d8b2875-4553-4dba-bacf-bf011e694960 req-6c4b98a5-979d-4766-a38e-d75845a6d5b5 tempest-AttachVolumeNegativeTest-1071383120 None] Terminate volume connection completed successfully. Sep 25 11:42:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-6d8b2875-4553-4dba-bacf-bf011e694960 req-6c4b98a5-979d-4766-a38e-d75845a6d5b5 tempest-AttachVolumeNegativeTest-1071383120 None] Deleting attachment 4b5dafae-5c6e-4c76-bd81-4151248c7e28. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:42:36 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 1073741824" returned: 0 in 0.730s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:36 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 Sep 25 11:42:36 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:37 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7" returned: 0 in 0.393s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d816f4-0567-48be-a622-2dd8f1b02442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66667d34-92f5-449e-ba2f-c3ff9df7326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:37 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Volume volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 (0bdbfc69-804b-4b17-a95e-e52a06d835b7): created successfully Sep 25 11:42:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66667d34-92f5-449e-ba2f-c3ff9df7326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Flow 'volume_create_manager' (60d5cf48-1dd2-465e-8e74-16c73f4add7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1267e385-c7a8-4f40-a3e0-374288ea238b tempest-VolumeQuotasNegativeTestJSON-679682346 None] Created volume successfully. Sep 25 11:42:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Acquiring lock "cinder-0bdbfc69-804b-4b17-a95e-e52a06d835b7-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "cinder-0bdbfc69-804b-4b17-a95e-e52a06d835b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Acquiring lock "cinder-quobyte-0bdbfc69-804b-4b17-a95e-e52a06d835b7" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "cinder-quobyte-0bdbfc69-804b-4b17-a95e-e52a06d835b7" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:39 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ecca5a-a22a-4aeb-8d64-329f579eaa64]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:39 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 Sep 25 11:42:39 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:40 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7" returned: 0 in 0.541s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:40 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7 Sep 25 11:42:40 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:40 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0bdbfc69-804b-4b17-a95e-e52a06d835b7" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "cinder-quobyte-0bdbfc69-804b-4b17-a95e-e52a06d835b7" released by "delete_volume" :: held 0.967s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Created reservations ['1ac3be74-1bf2-4fc5-9c39-bea49cca5d30', '4149b82c-3b20-4125-a03c-6f3c54b856a2', 'f54839a0-400c-4867-bb13-add4e44fedd2', '62e4c1c1-944e-4f4e-845f-ca315a58bb47'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:40 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:42:40 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:41 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.273s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:41 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:41 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Deleted volume successfully. Sep 25 11:42:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e254e292-748d-4995-8fd8-6af5f18526eb tempest-VolumeQuotasNegativeTestJSON-679682346 None] Lock "cinder-0bdbfc69-804b-4b17-a95e-e52a06d835b7-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Flow 'volume_create_manager' (64e5be9d-3ab3-464e-97c1-97b531ae6d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb63e7a-f761-43e4-aeb2-46610e773855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb63e7a-f761-43e4-aeb2-46610e773855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-892131587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ce448c-b448-45ed-8dbd-891ccbf83637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf69b029454dfaad4ed7574e9871c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:42Z,use_quota=True,user_id='119953c00790422192aefd82b1a93356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72de8bc4-7ed0-4512-81e0-3b071c6cf338),volume_type_id=72de8bc4-7ed0-4512-81e0-3b071c6cf338)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1190933-74d0-42c6-bf5a-867435a73ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1190933-74d0-42c6-bf5a-867435a73ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043f2482-fe92-42bd-b772-4aa8ab2b7521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043f2482-fe92-42bd-b772-4aa8ab2b7521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ce448c-b448-45ed-8dbd-891ccbf83637', 'volume_name': 'volume-a3ce448c-b448-45ed-8dbd-891ccbf83637', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72f80d9-6f26-4def-8779-0822914d0b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72f80d9-6f26-4def-8779-0822914d0b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bfb95d-fa20-4a43-ad38-0c6e39e4e654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume a3ce448c-b448-45ed-8dbd-891ccbf83637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ce448c-b448-45ed-8dbd-891ccbf83637', 'volume_size': 1} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-892131587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ce448c-b448-45ed-8dbd-891ccbf83637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf69b029454dfaad4ed7574e9871c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:42Z,use_quota=True,user_id='119953c00790422192aefd82b1a93356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72de8bc4-7ed0-4512-81e0-3b071c6cf338),volume_type_id=72de8bc4-7ed0-4512-81e0-3b071c6cf338)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Creating volume a3ce448c-b448-45ed-8dbd-891ccbf83637 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:42 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:42:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:42 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 1073741824 Sep 25 11:42:42 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Flow 'volume_create_manager' (b4b522dc-9d7d-4c56-a3bd-c1b1c8525ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b612f97-4d66-4a04-b156-bb2a1229d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b612f97-4d66-4a04-b156-bb2a1229d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-754251276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d6b798-5038-4aee-bf8b-64e20129003d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf69b029454dfaad4ed7574e9871c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:43Z,use_quota=True,user_id='119953c00790422192aefd82b1a93356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(973ff59c-d181-45eb-99fe-659cc162686b),volume_type_id=973ff59c-d181-45eb-99fe-659cc162686b)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd6f4af-5ac7-431d-ab91-2e2a565d24e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd6f4af-5ac7-431d-ab91-2e2a565d24e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c437793c-86fd-4aa6-bfb5-984608cde6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c437793c-86fd-4aa6-bfb5-984608cde6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d6b798-5038-4aee-bf8b-64e20129003d', 'volume_name': 'volume-32d6b798-5038-4aee-bf8b-64e20129003d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f56692-d534-4ff0-9ce6-9bea26c9c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f56692-d534-4ff0-9ce6-9bea26c9c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fedd39-e9bf-421e-a515-336b5ded2183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:43 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume 32d6b798-5038-4aee-bf8b-64e20129003d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d6b798-5038-4aee-bf8b-64e20129003d', 'volume_size': 1} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:43 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 1073741824" returned: 0 in 0.808s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:43 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 Sep 25 11:42:43 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:43 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637" returned: 0 in 0.383s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-754251276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d6b798-5038-4aee-bf8b-64e20129003d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf69b029454dfaad4ed7574e9871c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:43Z,use_quota=True,user_id='119953c00790422192aefd82b1a93356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(973ff59c-d181-45eb-99fe-659cc162686b),volume_type_id=973ff59c-d181-45eb-99fe-659cc162686b)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Creating volume 32d6b798-5038-4aee-bf8b-64e20129003d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:43 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:43 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d 1073741824 Sep 25 11:42:43 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bfb95d-fa20-4a43-ad38-0c6e39e4e654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ce448c-b448-45ed-8dbd-891ccbf83637', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664fdc09-aa79-4f11-927d-0accd861f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:43 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 (a3ce448c-b448-45ed-8dbd-891ccbf83637): created successfully Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664fdc09-aa79-4f11-927d-0accd861f799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Flow 'volume_create_manager' (64e5be9d-3ab3-464e-97c1-97b531ae6d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-af410111-e4cd-4849-a1e7-e01227dedb7d tempest-TestInstancesWithCinderVolumes-1303414718 None] Created volume successfully. Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Flow 'volume_create_manager' (213071d9-a986-48af-b663-ea3133630710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca352379-b65d-4c3f-8fcd-60146e539982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:44 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d 1073741824" returned: 0 in 0.888s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca352379-b65d-4c3f-8fcd-60146e539982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-680432183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8da466-4374-4887-b3e3-e23f54c52ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf69b029454dfaad4ed7574e9871c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:45Z,use_quota=True,user_id='119953c00790422192aefd82b1a93356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(573e7950-69a2-40ac-b7b8-c548b350f40d),volume_type_id=573e7950-69a2-40ac-b7b8-c548b350f40d)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c96448-42b9-4743-b753-8d109e0839a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c96448-42b9-4743-b753-8d109e0839a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d267b54-77d9-4f4a-93d1-cc3b3bfbf817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:42:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:44 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d Sep 25 11:42:44 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:45 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d" returned: 0 in 0.435s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fedd39-e9bf-421e-a515-336b5ded2183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d6b798-5038-4aee-bf8b-64e20129003d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316e6390-17a2-40dc-a111-fbc81e1139d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume volume-32d6b798-5038-4aee-bf8b-64e20129003d (32d6b798-5038-4aee-bf8b-64e20129003d): created successfully Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316e6390-17a2-40dc-a111-fbc81e1139d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Flow 'volume_create_manager' (b4b522dc-9d7d-4c56-a3bd-c1b1c8525ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1e52ba91-6e66-4bef-9bec-c07e3d1ca2f9 tempest-TestInstancesWithCinderVolumes-1303414718 None] Created volume successfully. Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d267b54-77d9-4f4a-93d1-cc3b3bfbf817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa8da466-4374-4887-b3e3-e23f54c52ecc', 'volume_name': 'volume-aa8da466-4374-4887-b3e3-e23f54c52ecc', 'volume_size': 1, 'image_id': 'b6616902-0a1d-43a3-88e9-27c345f91c42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6616902-0a1d-43a3-88e9-27c345f91c42', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1451033712', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddf69b029454dfaad4ed7574e9871c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b6616902-0a1d-43a3-88e9-27c345f91c42', 'created_at': datetime.datetime(2026, 9, 25, 9, 42, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 42, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6616902-0a1d-43a3-88e9-27c345f91c42/file', 'properties': {}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6441b11-9a8e-49e1-a6bc-2dfb5f488ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6441b11-9a8e-49e1-a6bc-2dfb5f488ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfa4b10-cfc6-410d-a651-5e32469c7092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume aa8da466-4374-4887-b3e3-e23f54c52ecc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa8da466-4374-4887-b3e3-e23f54c52ecc', 'volume_size': 1, 'image_id': 'b6616902-0a1d-43a3-88e9-27c345f91c42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6616902-0a1d-43a3-88e9-27c345f91c42', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1451033712', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddf69b029454dfaad4ed7574e9871c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b6616902-0a1d-43a3-88e9-27c345f91c42', 'created_at': datetime.datetime(2026, 9, 25, 9, 42, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 42, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6616902-0a1d-43a3-88e9-27c345f91c42/file', 'properties': {}}, 'image_service': } Sep 25 11:42:45 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Trying to clone aa8da466-4374-4887-b3e3-e23f54c52ecc from image b6616902-0a1d-43a3-88e9-27c345f91c42 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b6616902-0a1d-43a3-88e9-27c345f91c42', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:42:50 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD, size 20.69 MB, duration 4.42 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:42:50 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Image download 20.69 MB at 4.68 MB/s Sep 25 11:42:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f0a7f-bed6-407e-a889-8519397f3da9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:50 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD Sep 25 11:42:50 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:50 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:50 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Temporary image b6616902-0a1d-43a3-88e9-27c345f91c42 is fetched for user 119953c00790422192aefd82b1a93356. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:42:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3aa4f8-e0d3-4a3f-8671-763c95418169]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:51 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD Sep 25 11:42:51 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:51 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-680432183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8da466-4374-4887-b3e3-e23f54c52ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf69b029454dfaad4ed7574e9871c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:45Z,use_quota=True,user_id='119953c00790422192aefd82b1a93356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(573e7950-69a2-40ac-b7b8-c548b350f40d),volume_type_id=573e7950-69a2-40ac-b7b8-c548b350f40d)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Creating volume aa8da466-4374-4887-b3e3-e23f54c52ecc {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:51 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:42:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:51 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc 1073741824 Sep 25 11:42:51 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:52 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc 1073741824" returned: 0 in 0.633s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:52 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc Sep 25 11:42:52 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:52 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc" returned: 0 in 0.359s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:52 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Attempting download of b6616902-0a1d-43a3-88e9-27c345f91c42 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6616902-0a1d-43a3-88e9-27c345f91c42', 'metadata': {}}])) to volume aa8da466-4374-4887-b3e3-e23f54c52ecc. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:42:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6f0435-984b-4829-81fb-298ce24ef801]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6616902-0a1d-43a3-88e9-27c345f91c42_lm2l3pvb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:52 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6616902-0a1d-43a3-88e9-27c345f91c42_lm2l3pvb Sep 25 11:42:52 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:53 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6616902-0a1d-43a3-88e9-27c345f91c42_lm2l3pvb" returned: 0 in 0.500s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6616902-0a1d-43a3-88e9-27c345f91c42_lm2l3pvb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:53 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6616902-0a1d-43a3-88e9-27c345f91c42_lm2l3pvb Sep 25 11:42:53 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:53 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6616902-0a1d-43a3-88e9-27c345f91c42_lm2l3pvb" returned: 1 in 0.491s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6616902-0a1d-43a3-88e9-27c345f91c42_lm2l3pvb' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:42:53 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547e658-28c8-4333-8669-06463a11cacf]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:53 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD Sep 25 11:42:53 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:54 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD" returned: 0 in 0.879s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:54 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] b6616902-0a1d-43a3-88e9-27c345f91c42 was qcow2, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:42:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:54 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc Sep 25 11:42:54 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:57 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc" returned: 0 in 3.065s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:57 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b6616902-0a1d-43a3-88e9-27c345f91c42_l0z2i9qkdevstack@QuobyteHD, size 112.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:42:57 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Converted 112.00 MB image at 36.53 MB/s Sep 25 11:42:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:57 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc 1G Sep 25 11:42:57 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:58 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc 1G" returned: 0 in 0.526s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Downloaded image b6616902-0a1d-43a3-88e9-27c345f91c42 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6616902-0a1d-43a3-88e9-27c345f91c42', 'metadata': {}}])) to volume aa8da466-4374-4887-b3e3-e23f54c52ecc successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Temporary image b6616902-0a1d-43a3-88e9-27c345f91c42 for user 119953c00790422192aefd82b1a93356 is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Marking volume aa8da466-4374-4887-b3e3-e23f54c52ecc as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Copying metadata from image b6616902-0a1d-43a3-88e9-27c345f91c42 to aa8da466-4374-4887-b3e3-e23f54c52ecc. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Creating volume glance metadata for volume aa8da466-4374-4887-b3e3-e23f54c52ecc backed by image b6616902-0a1d-43a3-88e9-27c345f91c42 with: {'image_id': 'b6616902-0a1d-43a3-88e9-27c345f91c42', 'image_name': 'tempest-scenario-img--1451033712', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfa4b10-cfc6-410d-a651-5e32469c7092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8da466-4374-4887-b3e3-e23f54c52ecc', 'volume_size': 1, 'image_id': 'b6616902-0a1d-43a3-88e9-27c345f91c42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6616902-0a1d-43a3-88e9-27c345f91c42', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1451033712', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cddf69b029454dfaad4ed7574e9871c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b6616902-0a1d-43a3-88e9-27c345f91c42', 'created_at': datetime.datetime(2026, 9, 25, 9, 42, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 42, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6616902-0a1d-43a3-88e9-27c345f91c42/file', 'properties': {}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8b1a85-b73b-4dcd-aa48-81d7b58f21bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:58 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Volume volume-aa8da466-4374-4887-b3e3-e23f54c52ecc (aa8da466-4374-4887-b3e3-e23f54c52ecc): created successfully Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8b1a85-b73b-4dcd-aa48-81d7b58f21bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Flow 'volume_create_manager' (213071d9-a986-48af-b663-ea3133630710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-138c6aea-c210-4282-a809-687a74400228 tempest-TestInstancesWithCinderVolumes-1303414718 None] Created volume successfully. Sep 25 11:43:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-96eee79d-aebf-4d96-b45c-ea97d0a026e7 req-11b0db5d-0ddc-4064-a7e6-7f1202e74fe2 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-96eee79d-aebf-4d96-b45c-ea97d0a026e7 req-11b0db5d-0ddc-4064-a7e6-7f1202e74fe2 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-96eee79d-aebf-4d96-b45c-ea97d0a026e7 req-11b0db5d-0ddc-4064-a7e6-7f1202e74fe2 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-96eee79d-aebf-4d96-b45c-ea97d0a026e7 req-11b0db5d-0ddc-4064-a7e6-7f1202e74fe2 tempest-TestInstancesWithCinderVolumes-1303414718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-aa8da466-4374-4887-b3e3-e23f54c52ecc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb6b6e00-353a-4161-bf5f-f93d9fab3489', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:43:03 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-96eee79d-aebf-4d96-b45c-ea97d0a026e7 req-11b0db5d-0ddc-4064-a7e6-7f1202e74fe2 tempest-TestInstancesWithCinderVolumes-1303414718 None] attachment_update completed successfully. Sep 25 11:43:13 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=26,cinder:UPDATE=20,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:43:13 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=26,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Flow 'volume_create_manager' (54190266-94ea-4b30-8569-c959e1d54079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cccc57-96a6-41fa-8b04-3e170a96d3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cccc57-96a6-41fa-8b04-3e170a96d3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-449244830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef7c0d9-fd09-429b-9c92-1f89c691eb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939724f79f144e22b382fa62d47adf34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:23Z,use_quota=True,user_id='f78b92347afe49d8af6884b386feb4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66754098-b720-443a-9498-33382cedab52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66754098-b720-443a-9498-33382cedab52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4199978-06c0-41c8-88a7-2fa2404c7012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4199978-06c0-41c8-88a7-2fa2404c7012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef7c0d9-fd09-429b-9c92-1f89c691eb0c', 'volume_name': 'volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05089bd-a1de-4f0b-a980-09393ba47b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05089bd-a1de-4f0b-a980-09393ba47b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6dc324-2201-4b50-a2e1-f5dc9da7f1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:23 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Volume 9ef7c0d9-fd09-429b-9c92-1f89c691eb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c', 'volume_size': 1} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-449244830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef7c0d9-fd09-429b-9c92-1f89c691eb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939724f79f144e22b382fa62d47adf34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:23Z,use_quota=True,user_id='f78b92347afe49d8af6884b386feb4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Creating volume 9ef7c0d9-fd09-429b-9c92-1f89c691eb0c {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:43:23 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:43:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:43:23 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c 1073741824 Sep 25 11:43:23 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:24 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c 1073741824" returned: 0 in 0.782s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:24 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c Sep 25 11:43:24 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:24 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c" returned: 0 in 0.302s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6dc324-2201-4b50-a2e1-f5dc9da7f1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29329e2e-a2f9-4f2a-b48e-97f340915e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:24 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Volume volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c (9ef7c0d9-fd09-429b-9c92-1f89c691eb0c): created successfully Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29329e2e-a2f9-4f2a-b48e-97f340915e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Flow 'volume_create_manager' (54190266-94ea-4b30-8569-c959e1d54079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:24 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-38c383b3-9133-4316-8cc2-85fadddcec6f tempest-AttachVolumeNegativeTest-1071383120 None] Created volume successfully. Sep 25 11:43:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-28120ee7-22b8-4dd0-ac6d-f5d4dbee5553 req-3ed21ef0-9473-4230-b7b6-b6bcdca046fe tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-28120ee7-22b8-4dd0-ac6d-f5d4dbee5553 req-3ed21ef0-9473-4230-b7b6-b6bcdca046fe tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-28120ee7-22b8-4dd0-ac6d-f5d4dbee5553 req-3ed21ef0-9473-4230-b7b6-b6bcdca046fe tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-28120ee7-22b8-4dd0-ac6d-f5d4dbee5553 req-3ed21ef0-9473-4230-b7b6-b6bcdca046fe tempest-AttachVolumeNegativeTest-1071383120 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0b8bc33-98c9-487d-accf-2857f0e86665', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:43:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-28120ee7-22b8-4dd0-ac6d-f5d4dbee5553 req-3ed21ef0-9473-4230-b7b6-b6bcdca046fe tempest-AttachVolumeNegativeTest-1071383120 None] attachment_update completed successfully. Sep 25 11:43:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-5ec9573b-7266-4f13-a18c-2f0a4cdd0afc req-fc4f8fad-5881-4f67-a7dd-2d4ad41701f3 tempest-AttachVolumeNegativeTest-1071383120 None] Terminate volume connection completed successfully. Sep 25 11:43:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-5ec9573b-7266-4f13-a18c-2f0a4cdd0afc req-fc4f8fad-5881-4f67-a7dd-2d4ad41701f3 tempest-AttachVolumeNegativeTest-1071383120 None] Deleting attachment e0b8bc33-98c9-487d-accf-2857f0e86665. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:43:39 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:43:39 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=4,cinder:SELECT=11 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:43:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8f16ee99-1d43-4ada-926e-065f0a6c5183 req-6cb6855d-ffbe-4766-afab-92067e8658c0 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8f16ee99-1d43-4ada-926e-065f0a6c5183 req-6cb6855d-ffbe-4766-afab-92067e8658c0 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8f16ee99-1d43-4ada-926e-065f0a6c5183 req-6cb6855d-ffbe-4766-afab-92067e8658c0 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8f16ee99-1d43-4ada-926e-065f0a6c5183 req-6cb6855d-ffbe-4766-afab-92067e8658c0 tempest-TestInstancesWithCinderVolumes-1303414718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-a3ce448c-b448-45ed-8dbd-891ccbf83637', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62e2d9bf-b3e8-40e5-8546-08e693834114', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:43:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-8f16ee99-1d43-4ada-926e-065f0a6c5183 req-6cb6855d-ffbe-4766-afab-92067e8658c0 tempest-TestInstancesWithCinderVolumes-1303414718 None] attachment_update completed successfully. Sep 25 11:43:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-2949d89c-5d4c-47a0-9f9e-f518ba340d54 req-790374e4-57cf-4b0b-9184-6c513ef30338 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-2949d89c-5d4c-47a0-9f9e-f518ba340d54 req-790374e4-57cf-4b0b-9184-6c513ef30338 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-2949d89c-5d4c-47a0-9f9e-f518ba340d54 req-790374e4-57cf-4b0b-9184-6c513ef30338 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-2949d89c-5d4c-47a0-9f9e-f518ba340d54 req-790374e4-57cf-4b0b-9184-6c513ef30338 tempest-TestInstancesWithCinderVolumes-1303414718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-32d6b798-5038-4aee-bf8b-64e20129003d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aaad3849-d253-4c2a-af84-469aae671653', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:43:48 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-2949d89c-5d4c-47a0-9f9e-f518ba340d54 req-790374e4-57cf-4b0b-9184-6c513ef30338 tempest-TestInstancesWithCinderVolumes-1303414718 None] attachment_update completed successfully. Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (ab7e33ef-512a-4161-bb96-fe269816cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786d6b55-d914-4c4d-9f27-4f204111c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786d6b55-d914-4c4d-9f27-4f204111c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-46760428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201e7bd2-34fb-414b-b902-ba8308522e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:51Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599f9e86-35c5-41a7-866b-4e4f1baf2bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599f9e86-35c5-41a7-866b-4e4f1baf2bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a51ac2a-4cc5-48ff-83d6-4525e02c37ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a51ac2a-4cc5-48ff-83d6-4525e02c37ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201e7bd2-34fb-414b-b902-ba8308522e66', 'volume_name': 'volume-201e7bd2-34fb-414b-b902-ba8308522e66', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297c5d54-8d94-4b0d-8363-e07179f48ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297c5d54-8d94-4b0d-8363-e07179f48ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd8fba4-eb42-4327-8496-168729fbce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:51 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Volume 201e7bd2-34fb-414b-b902-ba8308522e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201e7bd2-34fb-414b-b902-ba8308522e66', 'volume_size': 1} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-46760428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201e7bd2-34fb-414b-b902-ba8308522e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:51Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Creating volume 201e7bd2-34fb-414b-b902-ba8308522e66 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:43:51 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:43:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:51 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 1073741824 Sep 25 11:43:51 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:52 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 1073741824" returned: 0 in 1.064s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:52 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 Sep 25 11:43:52 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:52 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66" returned: 0 in 0.429s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd8fba4-eb42-4327-8496-168729fbce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201e7bd2-34fb-414b-b902-ba8308522e66', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29c13f3-e054-4ee3-814c-52d5ee15a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:52 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Volume volume-201e7bd2-34fb-414b-b902-ba8308522e66 (201e7bd2-34fb-414b-b902-ba8308522e66): created successfully Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29c13f3-e054-4ee3-814c-52d5ee15a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (ab7e33ef-512a-4161-bb96-fe269816cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9236fc1f-7aa0-4298-ac7b-c283d2b32c61 tempest-VolumesActionsTest-1001944624 None] Created volume successfully. Sep 25 11:43:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6bf150dc-1af2-4d6a-ab67-0ebab8b9cbca tempest-VolumesActionsTest-1001944624 None] Acquiring lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66" by "attach_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6bf150dc-1af2-4d6a-ab67-0ebab8b9cbca tempest-VolumesActionsTest-1001944624 None] Lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66" acquired by "attach_volume" :: waited 0.079s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6bf150dc-1af2-4d6a-ab67-0ebab8b9cbca tempest-VolumesActionsTest-1001944624 None] Attaching volume 201e7bd2-34fb-414b-b902-ba8308522e66 to instance 937a6834-6345-4462-8b6c-b1e26a4cbf77 at mountpoint /dev/vdb on host None. Sep 25 11:43:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6bf150dc-1af2-4d6a-ab67-0ebab8b9cbca tempest-VolumesActionsTest-1001944624 None] Attach volume completed successfully. Sep 25 11:43:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6bf150dc-1af2-4d6a-ab67-0ebab8b9cbca tempest-VolumesActionsTest-1001944624 None] Lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66" released by "attach_volume" :: held 0.305s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fe2f1a36-8677-4e3f-ab6a-45c27650e993 tempest-VolumesActionsTest-1812054169 None] Terminate volume connection completed successfully. Sep 25 11:43:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fe2f1a36-8677-4e3f-ab6a-45c27650e993 tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-detach_volume" by "detach_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fe2f1a36-8677-4e3f-ab6a-45c27650e993 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fe2f1a36-8677-4e3f-ab6a-45c27650e993 tempest-VolumesActionsTest-1812054169 None] Detaching volume 201e7bd2-34fb-414b-b902-ba8308522e66 from instance 937a6834-6345-4462-8b6c-b1e26a4cbf77. Sep 25 11:43:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fe2f1a36-8677-4e3f-ab6a-45c27650e993 tempest-VolumesActionsTest-1812054169 None] Detach volume completed successfully. Sep 25 11:43:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fe2f1a36-8677-4e3f-ab6a-45c27650e993 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-cdb19ade-5f4f-4b1c-be23-682631cba992 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-detach_volume" by "detach_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-cdb19ade-5f4f-4b1c-be23-682631cba992 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-cdb19ade-5f4f-4b1c-be23-682631cba992 tempest-VolumesActionsTest-1001944624 None] Volume detach called, but volume not attached. Sep 25 11:43:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-cdb19ade-5f4f-4b1c-be23-682631cba992 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "cinder-quobyte-201e7bd2-34fb-414b-b902-ba8308522e66" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-quobyte-201e7bd2-34fb-414b-b902-ba8308522e66" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e987dc35-b70b-4218-af42-386bb9c873f9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:56 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 Sep 25 11:43:56 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:56 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66" returned: 0 in 0.554s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:56 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66 Sep 25 11:43:56 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:57 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-201e7bd2-34fb-414b-b902-ba8308522e66" returned: 0 in 0.305s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-quobyte-201e7bd2-34fb-414b-b902-ba8308522e66" released by "delete_volume" :: held 0.932s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Created reservations ['58ae9dd7-3a37-4e0c-9a9b-abd23fd61ab1', 'cb5f71c8-bf6d-4cca-b684-973a748e02ce', '81e0ff76-0b2f-43ad-8700-9a66bfa6dda6', '0c733881-92c7-48c9-a831-dae47476b159'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:57 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:43:57 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:57 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.335s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:43:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Deleted volume successfully. Sep 25 11:43:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-61c052e4-e527-4575-8733-c7a777e25265 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-201e7bd2-34fb-414b-b902-ba8308522e66-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-c29f9249-89c1-496a-af1d-bb67924aeefa req-a41ea78b-4d24-4572-aee5-5a3fb437b37d tempest-TestInstancesWithCinderVolumes-1303414718 None] Terminate volume connection completed successfully. Sep 25 11:43:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-c29f9249-89c1-496a-af1d-bb67924aeefa req-a41ea78b-4d24-4572-aee5-5a3fb437b37d tempest-TestInstancesWithCinderVolumes-1303414718 None] Deleting attachment 62e2d9bf-b3e8-40e5-8546-08e693834114. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:43:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "cinder-a3ce448c-b448-45ed-8dbd-891ccbf83637-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-a3ce448c-b448-45ed-8dbd-891ccbf83637-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "cinder-quobyte-a3ce448c-b448-45ed-8dbd-891ccbf83637" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-quobyte-a3ce448c-b448-45ed-8dbd-891ccbf83637" acquired by "delete_volume" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:58 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16680e7-d527-4cef-9956-702e86bbae25]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:59 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 Sep 25 11:43:59 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:59 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637" returned: 0 in 0.706s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:59 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637 Sep 25 11:43:59 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:00 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a3ce448c-b448-45ed-8dbd-891ccbf83637" returned: 0 in 0.439s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-quobyte-a3ce448c-b448-45ed-8dbd-891ccbf83637" released by "delete_volume" :: held 1.208s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:00 devstack cinder-volume[87356]: WARNING cinder.quota [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-419761294-1040414898 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-419761294-1040414898, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:00 devstack cinder-volume[87356]: WARNING cinder.quota [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-419761294-1040414898 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-419761294-1040414898, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Created reservations ['7c41f4ab-f9c9-4ff1-bb10-0c5a38aeaa4d', 'e17fe623-f827-493d-b829-5c2854441bb8', 'ce12fc0d-24ab-4c82-b47d-52e03528f0b5', '8bd0adef-3835-4606-a05b-4e893bb84754'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:00 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:00 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:00 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.484s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Deleted volume successfully. Sep 25 11:44:00 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0753c263-1582-4ab4-86ad-db3b0cabc165 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-a3ce448c-b448-45ed-8dbd-891ccbf83637-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (0a50ccd3-c7b7-4bef-b226-7cf3eb83d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fa82a6-dba5-4966-bd97-1e7de84a1020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fa82a6-dba5-4966-bd97-1e7de84a1020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1362788531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a9e76b-a40d-496a-ab30-9128b72d278c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:04Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d729c950-5896-41cc-809f-92810d1c444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d729c950-5896-41cc-809f-92810d1c444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a89f27d-5109-4bdd-89b7-e30ac66d50b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a89f27d-5109-4bdd-89b7-e30ac66d50b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a9e76b-a40d-496a-ab30-9128b72d278c', 'volume_name': 'volume-e7a9e76b-a40d-496a-ab30-9128b72d278c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ed49b2-1a4f-4247-9606-bc9e641828c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ed49b2-1a4f-4247-9606-bc9e641828c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffea791-df30-45d0-a32f-2777857dc6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:03 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Volume e7a9e76b-a40d-496a-ab30-9128b72d278c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a9e76b-a40d-496a-ab30-9128b72d278c', 'volume_size': 1} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1362788531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a9e76b-a40d-496a-ab30-9128b72d278c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:04Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Creating volume e7a9e76b-a40d-496a-ab30-9128b72d278c {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:03 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:44:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:03 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c 1073741824 Sep 25 11:44:03 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:04 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c 1073741824" returned: 0 in 0.591s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:04 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c Sep 25 11:44:04 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-2f17f4c4-65db-42b9-a5a9-c11bd53a8fdc req-1558928f-38ef-400b-bb80-fd25b250fe0c tempest-TestInstancesWithCinderVolumes-1303414718 None] Terminate volume connection completed successfully. Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-2f17f4c4-65db-42b9-a5a9-c11bd53a8fdc req-1558928f-38ef-400b-bb80-fd25b250fe0c tempest-TestInstancesWithCinderVolumes-1303414718 None] Deleting attachment aaad3849-d253-4c2a-af84-469aae671653. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:44:04 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c" returned: 0 in 0.390s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffea791-df30-45d0-a32f-2777857dc6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a9e76b-a40d-496a-ab30-9128b72d278c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2717ced-cbda-44bf-8582-b88c5a60521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:04 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Volume volume-e7a9e76b-a40d-496a-ab30-9128b72d278c (e7a9e76b-a40d-496a-ab30-9128b72d278c): created successfully Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2717ced-cbda-44bf-8582-b88c5a60521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (0a50ccd3-c7b7-4bef-b226-7cf3eb83d52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a45df42d-6e07-4788-9d8f-51d67593d49f tempest-VolumesActionsTest-1001944624 None] Created volume successfully. Sep 25 11:44:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "cinder-32d6b798-5038-4aee-bf8b-64e20129003d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-32d6b798-5038-4aee-bf8b-64e20129003d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "cinder-quobyte-32d6b798-5038-4aee-bf8b-64e20129003d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-quobyte-32d6b798-5038-4aee-bf8b-64e20129003d" acquired by "delete_volume" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:05 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a31d9-a1a9-4b94-aaf0-31a2a5e2fe1d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:05 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d Sep 25 11:44:05 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:05 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d" returned: 0 in 0.482s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:05 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d Sep 25 11:44:05 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-e7a9e76b-a40d-496a-ab30-9128b72d278c-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Lock "cinder-e7a9e76b-a40d-496a-ab30-9128b72d278c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:06 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-32d6b798-5038-4aee-bf8b-64e20129003d" returned: 0 in 0.396s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-quobyte-32d6b798-5038-4aee-bf8b-64e20129003d" released by "delete_volume" :: held 0.965s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-quobyte-e7a9e76b-a40d-496a-ab30-9128b72d278c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Lock "cinder-quobyte-e7a9e76b-a40d-496a-ab30-9128b72d278c" acquired by "delete_volume" :: waited 0.037s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:06 devstack cinder-volume[87356]: WARNING cinder.quota [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2044861107-558118465 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2044861107-558118465, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:06 devstack cinder-volume[87356]: WARNING cinder.quota [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2044861107-558118465 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2044861107-558118465, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e83a7e-73e6-4fe6-9d0d-5dd5340ebc77]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Created reservations ['bf672eda-ca2b-4e34-ac80-469fa34d0fe6', 'f6c0113f-1770-4a79-85d9-ff3f043fd158', '7c2d7f92-50d2-4ba1-bc22-ab2cad0189d1', 'fb9d92e3-48c1-4fe7-91f4-62b83557495e'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:06 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:06 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:06 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c Sep 25 11:44:06 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:06 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.359s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:06 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Deleted volume successfully. Sep 25 11:44:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-942ccaa8-e267-435b-a097-64c19b91048f tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-32d6b798-5038-4aee-bf8b-64e20129003d-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:06 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c" returned: 0 in 0.657s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:07 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c Sep 25 11:44:07 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:07 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e7a9e76b-a40d-496a-ab30-9128b72d278c" returned: 0 in 0.427s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Lock "cinder-quobyte-e7a9e76b-a40d-496a-ab30-9128b72d278c" released by "delete_volume" :: held 1.162s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Created reservations ['ee7ad253-b0e2-4be1-9c37-a35f431a1cd1', 'b9aa07b7-3950-46d7-b34c-10c5f1fc6291', '134c2d2e-aeb0-40c4-86d1-9dae99484b66', '8d7a8b22-d170-4e43-9cba-391e0f406762'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:07 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:07 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:07 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.299s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:07 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Deleted volume successfully. Sep 25 11:44:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4e509f58-2114-4124-8d5d-b4017c743a2c tempest-VolumesActionsTest-1812054169 None] Lock "cinder-e7a9e76b-a40d-496a-ab30-9128b72d278c-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (1be13630-ecab-4bd8-8fea-a49bb26cfbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f85a851-b1d9-462e-a2e0-53597855369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f85a851-b1d9-462e-a2e0-53597855369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1798617928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a0bf88-3140-41e2-af42-55fa98b48a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:09Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e172215-87e8-4253-b102-8a3451d3f305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e172215-87e8-4253-b102-8a3451d3f305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f819adb-33e4-4dd9-9a49-0c52699d27e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f819adb-33e4-4dd9-9a49-0c52699d27e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a0bf88-3140-41e2-af42-55fa98b48a3a', 'volume_name': 'volume-54a0bf88-3140-41e2-af42-55fa98b48a3a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa24edb3-a0d1-4a9e-963a-6bcd087a8a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa24edb3-a0d1-4a9e-963a-6bcd087a8a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0f38ef-c0d3-4933-984a-fd9e99c578a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Volume 54a0bf88-3140-41e2-af42-55fa98b48a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a0bf88-3140-41e2-af42-55fa98b48a3a', 'volume_size': 1} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1798617928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a0bf88-3140-41e2-af42-55fa98b48a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:09Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Creating volume 54a0bf88-3140-41e2-af42-55fa98b48a3a {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:09 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:44:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:09 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a 1073741824 Sep 25 11:44:09 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:10 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a 1073741824" returned: 0 in 0.839s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:10 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a Sep 25 11:44:10 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:10 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a" returned: 0 in 0.430s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0f38ef-c0d3-4933-984a-fd9e99c578a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a0bf88-3140-41e2-af42-55fa98b48a3a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40566dd-aeec-4142-b3d6-3720975d1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:10 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Volume volume-54a0bf88-3140-41e2-af42-55fa98b48a3a (54a0bf88-3140-41e2-af42-55fa98b48a3a): created successfully Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40566dd-aeec-4142-b3d6-3720975d1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (1be13630-ecab-4bd8-8fea-a49bb26cfbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-cbd9252c-e503-4b77-ab8e-4f301041910a req-3682e716-c8c5-4d1a-a95d-a935e23c52da tempest-TestInstancesWithCinderVolumes-1303414718 None] Terminate volume connection completed successfully. Sep 25 11:44:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-cbd9252c-e503-4b77-ab8e-4f301041910a req-3682e716-c8c5-4d1a-a95d-a935e23c52da tempest-TestInstancesWithCinderVolumes-1303414718 None] Deleting attachment cb6b6e00-353a-4161-bf5f-f93d9fab3489. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:44:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9be9cec0-143b-4cc5-a522-35e8bca87a1f tempest-VolumesActionsTest-1001944624 None] Created volume successfully. Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-54a0bf88-3140-41e2-af42-55fa98b48a3a-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-54a0bf88-3140-41e2-af42-55fa98b48a3a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-quobyte-54a0bf88-3140-41e2-af42-55fa98b48a3a" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-quobyte-54a0bf88-3140-41e2-af42-55fa98b48a3a" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7aac9-47cd-4c89-9f42-d90d3024b410]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "cinder-aa8da466-4374-4887-b3e3-e23f54c52ecc-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-aa8da466-4374-4887-b3e3-e23f54c52ecc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:11 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a Sep 25 11:44:11 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "cinder-quobyte-aa8da466-4374-4887-b3e3-e23f54c52ecc" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-quobyte-aa8da466-4374-4887-b3e3-e23f54c52ecc" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56c9aec-e460-4311-b638-fb7f3665cdb9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:12 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc Sep 25 11:44:12 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:12 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a" returned: 0 in 0.445s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:12 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a Sep 25 11:44:12 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:12 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:12 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc Sep 25 11:44:12 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:12 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-54a0bf88-3140-41e2-af42-55fa98b48a3a" returned: 0 in 0.369s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-quobyte-54a0bf88-3140-41e2-af42-55fa98b48a3a" released by "delete_volume" :: held 0.877s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Created reservations ['b0b15649-29a3-497a-960d-adccd752e97d', 'eb610019-ff18-4d1d-a92d-235d5193b8bb', '19dbd7b1-09aa-471b-a308-aef65f1fa077', '2fca7893-2f67-41e0-9ea1-75632a5fad22'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:12 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aa8da466-4374-4887-b3e3-e23f54c52ecc" returned: 0 in 0.351s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:12 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:12 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-quobyte-aa8da466-4374-4887-b3e3-e23f54c52ecc" released by "delete_volume" :: held 0.892s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:12 devstack cinder-volume[87356]: WARNING cinder.quota [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726485340-1227183384 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726485340-1227183384, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:12 devstack cinder-volume[87356]: WARNING cinder.quota [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726485340-1227183384 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726485340-1227183384, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Created reservations ['ee703ffd-e09a-4486-b065-e13fe8d79ba1', 'aee6dd8b-7657-44af-95fd-635c354aadfc', '79ec909a-f6e7-40ad-93c0-76ebe0fc1449', '948802b4-d4fb-43a5-9349-b0d162ac1714'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:13 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:13 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:13 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.509s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Deleted volume successfully. Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-86408eea-8226-40bf-95ff-502fc722c147 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-54a0bf88-3140-41e2-af42-55fa98b48a3a-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:13 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.543s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Deleted volume successfully. Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5240e05b-5da9-4e4c-b02a-33ea66d5cbf3 tempest-TestInstancesWithCinderVolumes-1303414718 None] Lock "cinder-aa8da466-4374-4887-b3e3-e23f54c52ecc-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (5efa8e38-9acb-4f58-8831-aa7e9402e08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb14b44-aa53-41f8-b8cf-4d295bf2cb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb14b44-aa53-41f8-b8cf-4d295bf2cb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1839857511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6079811f-d4f7-46e5-9a80-8656e8dc29bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:14Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a61beee-8bd4-4434-9431-9e4c325cfebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a61beee-8bd4-4434-9431-9e4c325cfebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a27988-aa3d-4f66-b8ec-f108cbbb075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a27988-aa3d-4f66-b8ec-f108cbbb075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6079811f-d4f7-46e5-9a80-8656e8dc29bb', 'volume_name': 'volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f7f897-0703-4a79-9357-8268fcd1b360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f7f897-0703-4a79-9357-8268fcd1b360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d45111-9a85-428e-832c-f4e9601aa049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:13 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Volume 6079811f-d4f7-46e5-9a80-8656e8dc29bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb', 'volume_size': 1} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1839857511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6079811f-d4f7-46e5-9a80-8656e8dc29bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:14Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Creating volume 6079811f-d4f7-46e5-9a80-8656e8dc29bb {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:14 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:44:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:14 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb 1073741824 Sep 25 11:44:14 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:14 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb 1073741824" returned: 0 in 0.737s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:14 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb Sep 25 11:44:14 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:15 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb" returned: 0 in 0.393s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d45111-9a85-428e-832c-f4e9601aa049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2b3fb3-26fd-47bc-b735-97444297e9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:15 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Volume volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb (6079811f-d4f7-46e5-9a80-8656e8dc29bb): created successfully Sep 25 11:44:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2b3fb3-26fd-47bc-b735-97444297e9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (5efa8e38-9acb-4f58-8831-aa7e9402e08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0e837f03-3693-4696-af56-c7d09335b9fe tempest-VolumesActionsTest-1001944624 None] Created volume successfully. Sep 25 11:44:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-6079811f-d4f7-46e5-9a80-8656e8dc29bb-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Lock "cinder-6079811f-d4f7-46e5-9a80-8656e8dc29bb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-quobyte-6079811f-d4f7-46e5-9a80-8656e8dc29bb" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Lock "cinder-quobyte-6079811f-d4f7-46e5-9a80-8656e8dc29bb" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:16 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd517f87-d429-43fc-917f-136028435cfb]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:16 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb Sep 25 11:44:16 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:16 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb" returned: 0 in 0.490s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:16 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb Sep 25 11:44:16 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:17 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6079811f-d4f7-46e5-9a80-8656e8dc29bb" returned: 0 in 0.300s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Lock "cinder-quobyte-6079811f-d4f7-46e5-9a80-8656e8dc29bb" released by "delete_volume" :: held 0.865s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Created reservations ['6f34f60e-3513-4035-b500-5463356c53e8', 'e03c7931-937f-43d2-92fa-c86f50655925', '60b76d40-6599-4332-947a-e9e64dcadfea', '4de3f9fc-0c07-4a86-83b3-633ade80417e'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:17 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:17 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:17 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.445s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Deleted volume successfully. Sep 25 11:44:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-54256361-33ca-4f57-bf8c-c0bc18a891db tempest-VolumesActionsTest-1812054169 None] Lock "cinder-6079811f-d4f7-46e5-9a80-8656e8dc29bb-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (af410ec3-6c5c-48fe-b30e-d583380f74a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf78033f-f3f4-4600-9a6b-608aaa996718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf78033f-f3f4-4600-9a6b-608aaa996718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064532014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9170ea76-0f7e-496e-aa49-a6361a087b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:18Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3616bcfd-57e2-4d52-85ee-77fef4383766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3616bcfd-57e2-4d52-85ee-77fef4383766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a3dcd8-5f06-4520-a5c5-75e2919ae6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a3dcd8-5f06-4520-a5c5-75e2919ae6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9170ea76-0f7e-496e-aa49-a6361a087b45', 'volume_name': 'volume-9170ea76-0f7e-496e-aa49-a6361a087b45', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290f796f-65e7-4087-b56a-3b222ef6c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290f796f-65e7-4087-b56a-3b222ef6c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b246e3fb-45b4-4fab-9ff5-680d17677d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Volume 9170ea76-0f7e-496e-aa49-a6361a087b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9170ea76-0f7e-496e-aa49-a6361a087b45', 'volume_size': 1} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064532014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9170ea76-0f7e-496e-aa49-a6361a087b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:18Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Creating volume 9170ea76-0f7e-496e-aa49-a6361a087b45 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:18 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:18 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 1073741824 Sep 25 11:44:18 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Flow 'volume_create_manager' (efb45d71-f19f-4f95-a3fe-a6db268452f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050b042e-0f72-4444-abe3-e8a3db7ed267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050b042e-0f72-4444-abe3-e8a3db7ed267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-649569975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f26660-9f7b-433b-8ade-9ee12220a727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939724f79f144e22b382fa62d47adf34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:19Z,use_quota=True,user_id='f78b92347afe49d8af6884b386feb4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d136ed4f-0c95-49ce-9e59-840fb3731ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d136ed4f-0c95-49ce-9e59-840fb3731ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fbf80f-0109-428c-bb88-e04befe39060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fbf80f-0109-428c-bb88-e04befe39060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72f26660-9f7b-433b-8ade-9ee12220a727', 'volume_name': 'volume-72f26660-9f7b-433b-8ade-9ee12220a727', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de262097-18e7-403a-b735-a89dd08d8da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de262097-18e7-403a-b735-a89dd08d8da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f636cabf-fbcc-4d6c-92cc-1f0f95f00399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:18 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Volume 72f26660-9f7b-433b-8ade-9ee12220a727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72f26660-9f7b-433b-8ade-9ee12220a727', 'volume_size': 1} Sep 25 11:44:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:19 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 1073741824" returned: 0 in 0.672s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:19 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 Sep 25 11:44:19 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:19 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45" returned: 0 in 0.331s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-649569975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f26660-9f7b-433b-8ade-9ee12220a727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939724f79f144e22b382fa62d47adf34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:19Z,use_quota=True,user_id='f78b92347afe49d8af6884b386feb4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Creating volume 72f26660-9f7b-433b-8ade-9ee12220a727 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:19 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:19 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 1073741824 Sep 25 11:44:19 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b246e3fb-45b4-4fab-9ff5-680d17677d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9170ea76-0f7e-496e-aa49-a6361a087b45', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91eeb91-f0f2-45b2-9bbb-29e22f744ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Volume volume-9170ea76-0f7e-496e-aa49-a6361a087b45 (9170ea76-0f7e-496e-aa49-a6361a087b45): created successfully Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91eeb91-f0f2-45b2-9bbb-29e22f744ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (af410ec3-6c5c-48fe-b30e-d583380f74a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:19 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e204121b-9879-485b-ae93-ebc1d69455bd tempest-VolumesActionsTest-1001944624 None] Created volume successfully. Sep 25 11:44:20 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 1073741824" returned: 0 in 0.587s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:20 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 Sep 25 11:44:20 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:20 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727" returned: 0 in 0.534s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f636cabf-fbcc-4d6c-92cc-1f0f95f00399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f26660-9f7b-433b-8ade-9ee12220a727', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbae077f-773c-4f7b-aad0-b33bdbea0359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-9170ea76-0f7e-496e-aa49-a6361a087b45-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Volume volume-72f26660-9f7b-433b-8ade-9ee12220a727 (72f26660-9f7b-433b-8ade-9ee12220a727): created successfully Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbae077f-773c-4f7b-aad0-b33bdbea0359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Flow 'volume_create_manager' (efb45d71-f19f-4f95-a3fe-a6db268452f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-9170ea76-0f7e-496e-aa49-a6361a087b45-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:20 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8a102eea-8c66-46af-b129-88adf71063c9 tempest-AttachVolumeNegativeTest-1071383120 None] Created volume successfully. Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Acquiring lock "cinder-quobyte-9170ea76-0f7e-496e-aa49-a6361a087b45" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-quobyte-9170ea76-0f7e-496e-aa49-a6361a087b45" acquired by "delete_volume" :: waited 0.015s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e535a-5bb1-476a-af55-30babfb16cc4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:21 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 Sep 25 11:44:21 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:21 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45" returned: 0 in 0.447s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:21 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45 Sep 25 11:44:21 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:21 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9170ea76-0f7e-496e-aa49-a6361a087b45" returned: 0 in 0.341s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-quobyte-9170ea76-0f7e-496e-aa49-a6361a087b45" released by "delete_volume" :: held 0.840s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Created reservations ['effb3cda-ccd7-43e5-b588-1781b91c3ed1', '2de4c2c7-cf2f-41b1-b47d-b8940beb9527', '77a760b6-6f9a-4b91-9f54-31a54ac50942', '91515bcb-9066-4a51-b6ff-ce9a439944b7'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:21 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:21 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:22 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.354s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Deleted volume successfully. Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c3dafc42-032b-4f95-9afe-687b37e10ed4 tempest-VolumesActionsTest-1812054169 None] Lock "cinder-9170ea76-0f7e-496e-aa49-a6361a087b45-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (6e55732c-4471-46da-a6b6-c39569e497c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204a1238-b9b6-468c-b13e-93eca1f193d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204a1238-b9b6-468c-b13e-93eca1f193d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1511296707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde4dafe-c404-40aa-a9f5-016319422bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:23Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2280435-ae31-42fc-8fa1-a22ebd103c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2280435-ae31-42fc-8fa1-a22ebd103c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b75e873-9da6-443c-a570-260448763078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b75e873-9da6-443c-a570-260448763078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde4dafe-c404-40aa-a9f5-016319422bad', 'volume_name': 'volume-dde4dafe-c404-40aa-a9f5-016319422bad', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bb5225-87c1-433d-b198-50c24cfce4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bb5225-87c1-433d-b198-50c24cfce4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec06c74-b964-4d8f-a21b-015b3c6fa600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:23 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Volume dde4dafe-c404-40aa-a9f5-016319422bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde4dafe-c404-40aa-a9f5-016319422bad', 'volume_size': 1} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1511296707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde4dafe-c404-40aa-a9f5-016319422bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9da9a4ab04ed38c348ab1fb06e9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:23Z,use_quota=True,user_id='444aded3147b4bbab1c4c24018c34582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Creating volume dde4dafe-c404-40aa-a9f5-016319422bad {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:23 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8b23c798-ef81-4f7c-8faa-2a021e1c9d30 req-294bfce5-5c4b-41f1-81fa-cdfdac9d6d3b tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:23 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad 1073741824 Sep 25 11:44:23 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:23 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:23 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:23 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.331s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:44:23 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad 1073741824" returned: 0 in 0.619s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:23 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad Sep 25 11:44:23 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:23 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad" returned: 0 in 0.295s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8b23c798-ef81-4f7c-8faa-2a021e1c9d30 req-294bfce5-5c4b-41f1-81fa-cdfdac9d6d3b tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.953s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec06c74-b964-4d8f-a21b-015b3c6fa600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde4dafe-c404-40aa-a9f5-016319422bad', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601d58f3-2446-4888-9409-9b1d087f1bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8b23c798-ef81-4f7c-8faa-2a021e1c9d30 req-294bfce5-5c4b-41f1-81fa-cdfdac9d6d3b tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:24 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Volume volume-dde4dafe-c404-40aa-a9f5-016319422bad (dde4dafe-c404-40aa-a9f5-016319422bad): created successfully Sep 25 11:44:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601d58f3-2446-4888-9409-9b1d087f1bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Flow 'volume_create_manager' (6e55732c-4471-46da-a6b6-c39569e497c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:24 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3e37d757-f7ab-48a8-bedb-6a9d6e0e41aa tempest-VolumesActionsTest-1001944624 None] Created volume successfully. Sep 25 11:44:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8b23c798-ef81-4f7c-8faa-2a021e1c9d30 req-294bfce5-5c4b-41f1-81fa-cdfdac9d6d3b tempest-AttachVolumeNegativeTest-1071383120 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-72f26660-9f7b-433b-8ade-9ee12220a727', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '959840c1-dc07-4f42-b171-69b746fc76e7', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:44:24 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-8b23c798-ef81-4f7c-8faa-2a021e1c9d30 req-294bfce5-5c4b-41f1-81fa-cdfdac9d6d3b tempest-AttachVolumeNegativeTest-1071383120 None] attachment_update completed successfully. Sep 25 11:44:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "cinder-dde4dafe-c404-40aa-a9f5-016319422bad-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-dde4dafe-c404-40aa-a9f5-016319422bad-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "cinder-quobyte-dde4dafe-c404-40aa-a9f5-016319422bad" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-quobyte-dde4dafe-c404-40aa-a9f5-016319422bad" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82ca185-e1f3-4f72-8c19-bb0a5b083550]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:26 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad Sep 25 11:44:26 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:26 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad" returned: 0 in 0.665s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:26 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad Sep 25 11:44:26 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:27 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde4dafe-c404-40aa-a9f5-016319422bad" returned: 0 in 0.451s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-quobyte-dde4dafe-c404-40aa-a9f5-016319422bad" released by "delete_volume" :: held 1.186s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Created reservations ['7ca280b4-c5c6-470d-99c9-4d8288a8507c', '49e202f5-8650-4c55-a628-65c2b0071158', '6a4c110a-f4e3-4b6b-a227-f75483bc7113', '2d7e08d8-65b5-4c08-9b7f-f75ecdaa4cf0'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:27 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:27 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:27 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-428ad9d6-6180-4f46-8a7e-e0962a41031a req-7461b96b-2fe2-435e-b604-649e42d916b9 tempest-AttachVolumeNegativeTest-1071383120 None] Terminate volume connection completed successfully. Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-428ad9d6-6180-4f46-8a7e-e0962a41031a req-7461b96b-2fe2-435e-b604-649e42d916b9 tempest-AttachVolumeNegativeTest-1071383120 None] Deleting attachment 959840c1-dc07-4f42-b171-69b746fc76e7. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:44:27 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.372s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:27 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Deleted volume successfully. Sep 25 11:44:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-10f1b8cb-6a94-4f28-8728-ae98252f23a5 tempest-VolumesActionsTest-1001944624 None] Lock "cinder-dde4dafe-c404-40aa-a9f5-016319422bad-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "cinder-72f26660-9f7b-433b-8ade-9ee12220a727-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-72f26660-9f7b-433b-8ade-9ee12220a727-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "cinder-quobyte-72f26660-9f7b-433b-8ade-9ee12220a727" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-quobyte-72f26660-9f7b-433b-8ade-9ee12220a727" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[666a9c47-6f36-46b8-84b4-7067281f41db]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:34 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 Sep 25 11:44:34 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:34 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727" returned: 0 in 0.531s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:34 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727 Sep 25 11:44:34 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:34 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72f26660-9f7b-433b-8ade-9ee12220a727" returned: 0 in 0.423s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-quobyte-72f26660-9f7b-433b-8ade-9ee12220a727" released by "delete_volume" :: held 1.022s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Created reservations ['27cce347-c3f5-4085-b057-5e5d62c16151', '5c80125c-686b-4edd-b5cf-3370bb3e2e3c', '64dba994-aeab-4582-9c28-35264702014f', 'd449b17c-b11e-4dfe-86a7-5d1817d9edce'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:35 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:35 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:35 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.392s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:35 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Deleted volume successfully. Sep 25 11:44:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-83d91152-92a6-4aff-b880-d869015f6ad4 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-72f26660-9f7b-433b-8ade-9ee12220a727-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "cinder-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "cinder-quobyte-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-quobyte-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:36 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7461677-9614-40ef-b11c-bc06e772a138]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:36 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c Sep 25 11:44:36 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:36 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c" returned: 0 in 0.491s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:36 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c Sep 25 11:44:36 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:37 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c" returned: 0 in 0.310s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-quobyte-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c" released by "delete_volume" :: held 0.884s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Created reservations ['c85cf04c-dcf0-4e40-a66a-d43423341685', '62cad4d6-1b58-4a39-ad68-a33b01dce664', 'e3017e74-ca08-47ca-b63a-d26df4129453', 'a8bbeeed-1b50-4479-b60a-47573082976b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:37 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:37 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "cinder-6310c049-7b05-4e9d-ba98-bdbb187e348c-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-6310c049-7b05-4e9d-ba98-bdbb187e348c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:37 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.387s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Deleted volume successfully. Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bf627d7b-42ea-4f48-b21f-7889b312d6c9 tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-9ef7c0d9-fd09-429b-9c92-1f89c691eb0c-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "cinder-quobyte-6310c049-7b05-4e9d-ba98-bdbb187e348c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-quobyte-6310c049-7b05-4e9d-ba98-bdbb187e348c" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5aa56-7bed-4357-9955-81dc3601b4cd]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:38 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c Sep 25 11:44:38 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:38 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c" returned: 0 in 0.432s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:38 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c Sep 25 11:44:38 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:38 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6310c049-7b05-4e9d-ba98-bdbb187e348c" returned: 0 in 0.297s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-quobyte-6310c049-7b05-4e9d-ba98-bdbb187e348c" released by "delete_volume" :: held 0.788s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Created reservations ['760545bd-8f4d-4ccf-97c4-e439e327ada7', '55f4369f-0ef2-45b2-84ef-1d10844d9b4e', 'd4b8bb73-e7ef-48cc-bb7b-7520ab166790', '2610467e-a095-40da-9765-f0de4c8356e6'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:38 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:44:38 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:39 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.374s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:39 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:39 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Deleted volume successfully. Sep 25 11:44:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f37ae1e8-48eb-4e44-9721-89d19155e6ef tempest-AttachVolumeNegativeTest-1071383120 None] Lock "cinder-6310c049-7b05-4e9d-ba98-bdbb187e348c-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:48 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=98,cinder:UPDATE=127,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:44:49 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=112,cinder:UPDATE=123,cinder:DELETE=11,cinder:INSERT=26 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Flow 'volume_create_manager' (a1d538d1-63dd-4d14-809c-c475664623ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f0e7bc-8e11-4a7d-afb0-8a7bcb02e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f0e7bc-8e11-4a7d-afb0-8a7bcb02e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1396355788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fce08a-63c6-4c48-9574-b8fe578eaaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729f78cf4819403c80a9c8eff77b4370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:54Z,use_quota=True,user_id='c0e6c5c6e65e44c9acb6e8cf9f12f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7b7d53-d94e-4e3d-970b-e119f0d15f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7b7d53-d94e-4e3d-970b-e119f0d15f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55d308d-1398-42bb-a9b1-47b11c34e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55d308d-1398-42bb-a9b1-47b11c34e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7fce08a-63c6-4c48-9574-b8fe578eaaf2', 'volume_name': 'volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b7a01a-10d1-4942-9ada-64a796390093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b7a01a-10d1-4942-9ada-64a796390093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90d1d05-2dd4-45ee-b572-5077f8fdd41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:54 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Volume c7fce08a-63c6-4c48-9574-b8fe578eaaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2', 'volume_size': 1} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1396355788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fce08a-63c6-4c48-9574-b8fe578eaaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729f78cf4819403c80a9c8eff77b4370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:54Z,use_quota=True,user_id='c0e6c5c6e65e44c9acb6e8cf9f12f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Creating volume c7fce08a-63c6-4c48-9574-b8fe578eaaf2 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:54 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:44:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:54 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 1073741824 Sep 25 11:44:54 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:55 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 1073741824" returned: 0 in 0.734s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:55 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 Sep 25 11:44:55 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:55 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" returned: 0 in 0.359s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90d1d05-2dd4-45ee-b572-5077f8fdd41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507fa6cb-6ea3-4d86-a001-724babbeb409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:55 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Volume volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 (c7fce08a-63c6-4c48-9574-b8fe578eaaf2): created successfully Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507fa6cb-6ea3-4d86-a001-724babbeb409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Flow 'volume_create_manager' (a1d538d1-63dd-4d14-809c-c475664623ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-8279a714-f5dd-45fb-8189-69ecb2d9a027 req-cf7bb331-5ee0-487e-83e1-b3b1bfbaf00d tempest-VolumesSnapshotsTestJSON-1643411772 None] Created volume successfully. Sep 25 11:44:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Creating offline snapshot 4eb3692a-7533-40cf-8626-435923ba72a7 of volume c7fce08a-63c6-4c48-9574-b8fe578eaaf2 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:44:57 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2a3833-b9f0-4e93-81e9-1ea457e970cd]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:57 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 Sep 25 11:44:57 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:57 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" returned: 0 in 0.734s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:57 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 1G Sep 25 11:44:57 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:58 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 1G" returned: 0 in 0.679s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:58 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 Sep 25 11:44:58 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:59 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7" returned: 0 in 0.461s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:59 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 is being set with open permissions: ugo+rw Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:59 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 Sep 25 11:44:59 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Flow 'volume_create_manager' (1312a744-c854-4180-9d39-6ffc557ebabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1214ba5b-74c5-442f-aeff-af3a188bd07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1214ba5b-74c5-442f-aeff-af3a188bd07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1866085674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe11645bdb724042bf43ec5ca098fa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:59Z,use_quota=True,user_id='d07b0a834fc042cb9df810a81b7b4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6021265d-ca3a-44c6-9aa2-b91fad878539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6021265d-ca3a-44c6-9aa2-b91fad878539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6080041b-8251-4cae-81ba-fc1b25ff0924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6080041b-8251-4cae-81ba-fc1b25ff0924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f', 'volume_name': 'volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdfde2b-f1b4-4520-9e81-a574da765b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdfde2b-f1b4-4520-9e81-a574da765b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dae0454-b0ee-46ff-a446-7e94f2a6af7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:59 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Volume 55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f', 'volume_size': 1} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:59 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7" returned: 0 in 0.310s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:59 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.info Sep 25 11:44:59 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:59 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.info" returned: 0 in 0.337s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:59 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.info is being set with open permissions: ugo+rw Sep 25 11:44:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:59 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.info Sep 25 11:44:59 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:00 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.info" returned: 0 in 0.370s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1866085674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe11645bdb724042bf43ec5ca098fa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:59Z,use_quota=True,user_id='d07b0a834fc042cb9df810a81b7b4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Creating volume 55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:00 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:00 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f 1073741824 Sep 25 11:45:00 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-e7c755cf-bd07-4e86-b275-d279370d158d req-9e88d378-0fa4-46af-9916-c7f1938206de tempest-VolumesSnapshotsTestJSON-1643411772 None] Create snapshot completed successfully Sep 25 11:45:00 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f 1073741824" returned: 0 in 0.770s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:01 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f Sep 25 11:45:01 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "cinder-4eb3692a-7533-40cf-8626-435923ba72a7-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-4eb3692a-7533-40cf-8626-435923ba72a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "cinder-quobyte-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-quobyte-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "cinder-quobyte-4eb3692a-7533-40cf-8626-435923ba72a7" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-quobyte-4eb3692a-7533-40cf-8626-435923ba72a7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Deleting offline snapshot 4eb3692a-7533-40cf-8626-435923ba72a7 of volume c7fce08a-63c6-4c48-9574-b8fe578eaaf2 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] snapshot_file for this snap is: volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dd7d5a-61e2-4a2b-95e3-314ba54adcc4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:01 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f" returned: 0 in 0.352s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dae0454-b0ee-46ff-a446-7e94f2a6af7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ba3f4c-bea9-4d57-a300-296ec04dd161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Volume volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f (55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f): created successfully Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ba3f4c-bea9-4d57-a300-296ec04dd161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Flow 'volume_create_manager' (1312a744-c854-4180-9d39-6ffc557ebabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:01 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-74c4baa9-092e-45ba-95a8-fd67f1c72d38 tempest-VolumesTransfersV357Test-849236824 None] Created volume successfully. Sep 25 11:45:01 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 Sep 25 11:45:01 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:01 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7" returned: 0 in 0.480s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd88297-bba8-4e50-b7de-7bd305d42240]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:01 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 Sep 25 11:45:01 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:02 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" returned: 0 in 0.516s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:02 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 Sep 25 11:45:02 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:02 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7" returned: 0 in 0.534s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:02 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7 Sep 25 11:45:02 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:03 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2.4eb3692a-7533-40cf-8626-435923ba72a7" returned: 0 in 0.391s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:03 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e7334042-8395-419e-829f-59f25a83335e tempest-VolumesTransfersV357Test-959751100 None] Transfer volume completed successfully. Sep 25 11:45:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-quobyte-4eb3692a-7533-40cf-8626-435923ba72a7" released by "_delete_snapshot" :: held 2.100s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-quobyte-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" released by "delete_snapshot" :: held 2.132s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:03 devstack cinder-volume[87356]: DEBUG cinder.quota [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Created reservations ['391bbf31-3ea3-40c3-b7e0-239deb1f8c6e', '42cbdf58-bacd-4553-aa22-038a29c9d9a7', '99d1ea01-6806-4afe-804a-7abec6912473', '58d26b9c-490a-438a-b45c-07ef9b1b838a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:03 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Delete snapshot completed successfully. Sep 25 11:45:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-f1fee692-b337-4396-8546-2c9c71613cfe req-d5811c96-ff62-4602-88dd-eff7575d9c4c tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-4eb3692a-7533-40cf-8626-435923ba72a7-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Acquiring lock "cinder-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Lock "cinder-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Acquiring lock "cinder-quobyte-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Lock "cinder-quobyte-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9edf31-6573-42ef-b320-1d2b16ce12f2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:04 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f Sep 25 11:45:04 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "cinder-c7fce08a-63c6-4c48-9574-b8fe578eaaf2-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:04 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f" returned: 0 in 0.514s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-c7fce08a-63c6-4c48-9574-b8fe578eaaf2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:04 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f Sep 25 11:45:04 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "cinder-quobyte-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-quobyte-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" acquired by "delete_volume" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e35406-5c17-4ab8-8d07-e9ec2ed4d0db]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:05 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 Sep 25 11:45:05 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:05 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f" returned: 0 in 0.317s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Lock "cinder-quobyte-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f" released by "delete_volume" :: held 0.885s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Created reservations ['cf7c688f-68d1-48c2-a73d-3520ac074532', '1d763520-9e90-403b-9b24-ee7181c44d42', 'ae84a2e9-b547-4c8f-93d4-8c0eebcde2f7', '61ea8cbd-b106-4f98-831a-58057f769da6'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:05 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:45:05 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:05 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" returned: 0 in 0.717s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:05 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2 Sep 25 11:45:05 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:05 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.649s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Deleted volume successfully. Sep 25 11:45:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bbdb9ae9-5d0b-45e0-8b96-f6d151750e13 tempest-VolumesTransfersV357Test-634818577 None] Lock "cinder-55b78ccc-b7db-4cd3-a5dd-a5d8e6bc0f9f-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:06 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" returned: 0 in 0.502s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-quobyte-c7fce08a-63c6-4c48-9574-b8fe578eaaf2" released by "delete_volume" :: held 1.335s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.quota [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Created reservations ['7bfd21c2-d6a4-465f-83d9-d3bc4c959c42', '069e8e2b-5859-414a-854d-e632b8d7bc6b', '2f21cdc0-1bf2-47a8-a7aa-d68af1c57f5b', 'ae64fd07-ed6c-4d89-89ca-7130b0b58960'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:06 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:45:06 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Flow 'volume_create_manager' (44d586e2-d218-43e3-9c83-c8959a097082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605cbec1-b0db-4aef-a04f-932f458a5f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605cbec1-b0db-4aef-a04f-932f458a5f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-223409890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64df4ce-75e2-4bd0-8efb-378d50eedf3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe11645bdb724042bf43ec5ca098fa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:06Z,use_quota=True,user_id='d07b0a834fc042cb9df810a81b7b4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218681a0-5a88-4dc7-8ac1-9e722a978bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218681a0-5a88-4dc7-8ac1-9e722a978bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48512f1a-a0b9-415f-9d55-ba4704d79e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48512f1a-a0b9-415f-9d55-ba4704d79e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64df4ce-75e2-4bd0-8efb-378d50eedf3f', 'volume_name': 'volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6202bee5-7e31-45e2-bba5-88ce6865c520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6202bee5-7e31-45e2-bba5-88ce6865c520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419f10ff-a604-4311-b945-e2519babddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Volume b64df4ce-75e2-4bd0-8efb-378d50eedf3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f', 'volume_size': 1} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-223409890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64df4ce-75e2-4bd0-8efb-378d50eedf3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe11645bdb724042bf43ec5ca098fa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:06Z,use_quota=True,user_id='d07b0a834fc042cb9df810a81b7b4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Creating volume b64df4ce-75e2-4bd0-8efb-378d50eedf3f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:06 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:06 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f 1073741824 Sep 25 11:45:06 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:06 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.388s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.manager [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:06 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Deleted volume successfully. Sep 25 11:45:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [req-b672e541-94f8-4ff1-b0a6-72e7fed4d56e req-fe9a6ded-d3cc-49f1-b593-69449469094e tempest-VolumesSnapshotsTestJSON-1643411772 None] Lock "cinder-c7fce08a-63c6-4c48-9574-b8fe578eaaf2-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:07 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f 1073741824" returned: 0 in 0.682s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:07 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f Sep 25 11:45:07 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:07 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f" returned: 0 in 0.375s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419f10ff-a604-4311-b945-e2519babddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa4ac1-705f-40cc-be04-b195544a00b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:07 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Volume volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f (b64df4ce-75e2-4bd0-8efb-378d50eedf3f): created successfully Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa4ac1-705f-40cc-be04-b195544a00b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Flow 'volume_create_manager' (44d586e2-d218-43e3-9c83-c8959a097082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-801e09e6-3c32-47f8-a8db-849fcefc4b1c tempest-VolumesTransfersV357Test-849236824 None] Created volume successfully. Sep 25 11:45:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Acquiring lock "cinder-b64df4ce-75e2-4bd0-8efb-378d50eedf3f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Lock "cinder-b64df4ce-75e2-4bd0-8efb-378d50eedf3f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Acquiring lock "cinder-quobyte-b64df4ce-75e2-4bd0-8efb-378d50eedf3f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Lock "cinder-quobyte-b64df4ce-75e2-4bd0-8efb-378d50eedf3f" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[87418a23-900a-4afc-bc46-d2de3b69fd04]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:09 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f Sep 25 11:45:09 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:09 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f" returned: 0 in 0.547s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:09 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f Sep 25 11:45:09 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:10 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b64df4ce-75e2-4bd0-8efb-378d50eedf3f" returned: 0 in 0.378s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Lock "cinder-quobyte-b64df4ce-75e2-4bd0-8efb-378d50eedf3f" released by "delete_volume" :: held 0.988s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Created reservations ['fe0ee52c-432a-44b7-88c5-836a144a5ad4', '02912b6f-a455-4b21-b840-a2c30f784e14', 'ae6bd774-ab2b-4b4d-9b14-9604f9c78633', '89c621ba-c1b4-4b9b-985d-0a58c2ee5939'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:10 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:45:10 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:10 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.325s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Deleted volume successfully. Sep 25 11:45:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-737d52ae-366f-4729-a447-12dd350655a5 tempest-VolumesTransfersV357Test-634818577 None] Lock "cinder-b64df4ce-75e2-4bd0-8efb-378d50eedf3f-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0139fa93-15d2-42f4-9e9e-bac4b57f0124 tempest-GroupSnapshotsV319Test-1694631798 None] Group tempest-GroupSnapshotsV319Test-Group-886854432: creating Sep 25 11:45:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0139fa93-15d2-42f4-9e9e-bac4b57f0124 tempest-GroupSnapshotsV319Test-1694631798 None] Group tempest-GroupSnapshotsV319Test-Group-886854432: created successfully Sep 25 11:45:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0139fa93-15d2-42f4-9e9e-bac4b57f0124 tempest-GroupSnapshotsV319Test-1694631798 None] Create group completed successfully. Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Flow 'volume_create_manager' (dd382f0b-5452-4fb1-bc6c-93cfee4763b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622c4b40-2875-49d3-8705-9f518bcde017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622c4b40-2875-49d3-8705-9f518bcde017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1966096537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43fe1266-0d18-4721-8392-1854f33a96eb,host='devstack@QuobyteHD#QuobyteHD',id=bc392508-776d-4cfa-8d08-98569b14b827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df451b0456e4d3997a2987e9f4bf96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:18Z,use_quota=True,user_id='156cf90f60664c4299050a751f9254b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(211a7e95-509e-43d6-8e64-36e935e318bd),volume_type_id=211a7e95-509e-43d6-8e64-36e935e318bd)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b270123-a6c5-4392-b82f-84c5e3cf9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b270123-a6c5-4392-b82f-84c5e3cf9842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c894c9-6aa0-4ddb-be41-4058882ec71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c894c9-6aa0-4ddb-be41-4058882ec71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc392508-776d-4cfa-8d08-98569b14b827', 'volume_name': 'volume-bc392508-776d-4cfa-8d08-98569b14b827', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d63f137-1833-44ab-8b47-7a6a9a68f4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d63f137-1833-44ab-8b47-7a6a9a68f4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53b00a1-fdbf-4906-8057-23f7da6e2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:17 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Volume bc392508-776d-4cfa-8d08-98569b14b827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc392508-776d-4cfa-8d08-98569b14b827', 'volume_size': 1} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43fe1266-0d18-4721-8392-1854f33a96eb,created_at=2026-09-25T09:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1966096537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43fe1266-0d18-4721-8392-1854f33a96eb,host='devstack@QuobyteHD#QuobyteHD',id=bc392508-776d-4cfa-8d08-98569b14b827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df451b0456e4d3997a2987e9f4bf96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:18Z,use_quota=True,user_id='156cf90f60664c4299050a751f9254b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(211a7e95-509e-43d6-8e64-36e935e318bd),volume_type_id=211a7e95-509e-43d6-8e64-36e935e318bd)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Creating volume bc392508-776d-4cfa-8d08-98569b14b827 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:17 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:45:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:17 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 1073741824 Sep 25 11:45:17 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:18 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 1073741824" returned: 0 in 0.707s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:18 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 Sep 25 11:45:18 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:19 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827" returned: 0 in 0.468s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53b00a1-fdbf-4906-8057-23f7da6e2f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc392508-776d-4cfa-8d08-98569b14b827', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd7e8c6-c8a5-4232-8a41-d6a9d6567fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Volume volume-bc392508-776d-4cfa-8d08-98569b14b827 (bc392508-776d-4cfa-8d08-98569b14b827): created successfully Sep 25 11:45:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd7e8c6-c8a5-4232-8a41-d6a9d6567fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Flow 'volume_create_manager' (dd382f0b-5452-4fb1-bc6c-93cfee4763b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:19 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c37f2709-7134-4af3-bedd-c743f32bead7 tempest-GroupSnapshotsV319Test-1694631798 None] Created volume successfully. Sep 25 11:45:20 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] GroupSnapshot d4b52ec7-540f-43ce-9fe1-0078797c7c11: creating. Sep 25 11:45:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Group snapshot d4b52ec7-540f-43ce-9fe1-0078797c7c11: creating. {{(pid=87356) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 11:45:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Creating offline snapshot ba457978-67aa-4a3a-b2ae-23c359a9b379 of volume bc392508-776d-4cfa-8d08-98569b14b827 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:45:20 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b314f99c-82e9-45fb-95b4-5e7c4a376d34]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:20 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 Sep 25 11:45:20 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:21 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827" returned: 0 in 0.568s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:21 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 1G Sep 25 11:45:21 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:22 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 1G" returned: 0 in 0.675s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc392508-776d-4cfa-8d08-98569b14b827 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:22 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc392508-776d-4cfa-8d08-98569b14b827 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 Sep 25 11:45:22 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:22 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc392508-776d-4cfa-8d08-98569b14b827 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379" returned: 0 in 0.491s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:22 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:45:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:22 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 Sep 25 11:45:22 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:22 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:23 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.info Sep 25 11:45:23 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:23 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:45:23 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:23 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.info" returned: 0 in 0.510s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:23 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:23 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.info Sep 25 11:45:23 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:23 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.514s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:45:23 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.info" returned: 0 in 0.375s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.218s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:24 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-26d79741-d6bb-464b-8a53-4feca3885c2b tempest-GroupSnapshotsV319Test-1694631798 None] group_snapshot d4b52ec7-540f-43ce-9fe1-0078797c7c11: created successfully Sep 25 11:45:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] group_snapshot d4b52ec7-540f-43ce-9fe1-0078797c7c11: deleting Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] group_snapshot d4b52ec7-540f-43ce-9fe1-0078797c7c11: deleting {{(pid=87356) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Acquiring lock "cinder-quobyte-bc392508-776d-4cfa-8d08-98569b14b827" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "cinder-quobyte-bc392508-776d-4cfa-8d08-98569b14b827" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Acquiring lock "cinder-quobyte-ba457978-67aa-4a3a-b2ae-23c359a9b379" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "cinder-quobyte-ba457978-67aa-4a3a-b2ae-23c359a9b379" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Deleting offline snapshot ba457978-67aa-4a3a-b2ae-23c359a9b379 of volume bc392508-776d-4cfa-8d08-98569b14b827 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] snapshot_file for this snap is: volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c376e4-bf2f-4aac-a57f-b652920ab3b4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:26 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 Sep 25 11:45:26 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:26 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379" returned: 0 in 0.498s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc392508-776d-4cfa-8d08-98569b14b827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:26 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8edba2-ab69-447e-8fa6-aac7c2feff5e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:26 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 Sep 25 11:45:26 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:26 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827" returned: 0 in 0.488s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:26 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 Sep 25 11:45:26 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:27 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379" returned: 0 in 0.406s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:27 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379 Sep 25 11:45:27 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:27 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827.ba457978-67aa-4a3a-b2ae-23c359a9b379" returned: 0 in 0.289s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "cinder-quobyte-ba457978-67aa-4a3a-b2ae-23c359a9b379" released by "_delete_snapshot" :: held 1.852s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "cinder-quobyte-bc392508-776d-4cfa-8d08-98569b14b827" released by "delete_snapshot" :: held 1.893s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:27 devstack cinder-volume[87356]: WARNING cinder.quota [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-814753596 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-814753596, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:45:27 devstack cinder-volume[87356]: WARNING cinder.quota [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-814753596 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-814753596, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:45:27 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] Created reservations ['cde423df-8764-430c-9100-e63ad092f526', 'bd67bd0f-005a-43cd-b861-dc4c480428e6', '334ac317-ab1a-414b-b6ce-384b6d03d38b', '434fc36a-9f8c-4cae-9f47-afb213f18cce'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:27 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b88a21f9-9b55-49aa-b9cd-eea533d1af35 tempest-GroupSnapshotsV319Test-1694631798 None] group_snapshot d4b52ec7-540f-43ce-9fe1-0078797c7c11: deleted successfully Sep 25 11:45:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Acquiring lock "cinder-quobyte-bc392508-776d-4cfa-8d08-98569b14b827" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "cinder-quobyte-bc392508-776d-4cfa-8d08-98569b14b827" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:28 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e8888-80e7-4505-9a16-fd52b89aec30]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:28 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 Sep 25 11:45:28 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:29 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827" returned: 0 in 0.463s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:29 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827 Sep 25 11:45:29 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:29 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc392508-776d-4cfa-8d08-98569b14b827" returned: 0 in 0.387s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "cinder-quobyte-bc392508-776d-4cfa-8d08-98569b14b827" released by "delete_volume" :: held 0.949s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Created reservations ['1f315042-55ac-44f6-b268-be17e208c616'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:29 devstack cinder-volume[87356]: WARNING cinder.quota [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-814753596 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-814753596, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Created reservations ['97b33f96-a131-4eb3-91b8-698c702933e3', '920bc7b0-0cf9-40a4-9c6a-74f773e12151', 'b99ad131-6087-4bd5-8d32-52037fa9707f', 'd4d2c697-dd7f-4011-abbb-fb014681af2d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:29 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:45:29 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:30 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.340s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:30 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:30 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fe82b641-2608-4e66-a9f7-0e1612e8ea55 tempest-GroupSnapshotsV319Test-1694631798 None] Delete group completed successfully. Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Flow 'volume_create_manager' (685f7672-b606-47a0-ba9e-b5775afaaa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683710b2-e2c7-48be-95dd-8b9d6ac43c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683710b2-e2c7-48be-95dd-8b9d6ac43c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24724468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbff6eb4-e4f1-4722-aeb4-516a0d673488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363a947ac1844462b40d4956486ece00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:36Z,use_quota=True,user_id='6bfa9f851c544ca58a879f00f2b1dd74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e94a75b-3dd4-4734-8067-c0f65807f37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e94a75b-3dd4-4734-8067-c0f65807f37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf00aa67-a9a5-4aad-875d-8bdf2180c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf00aa67-a9a5-4aad-875d-8bdf2180c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbff6eb4-e4f1-4722-aeb4-516a0d673488', 'volume_name': 'volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57ff652-8a07-4392-b20f-910b5174948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57ff652-8a07-4392-b20f-910b5174948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd0437e-e626-4bfe-b57a-a88adb5c990b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:36 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Volume fbff6eb4-e4f1-4722-aeb4-516a0d673488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488', 'volume_size': 1} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24724468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbff6eb4-e4f1-4722-aeb4-516a0d673488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363a947ac1844462b40d4956486ece00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:36Z,use_quota=True,user_id='6bfa9f851c544ca58a879f00f2b1dd74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Creating volume fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:36 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:45:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:36 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 1073741824 Sep 25 11:45:36 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:37 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 1073741824" returned: 0 in 0.580s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:37 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:45:37 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:37 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.382s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd0437e-e626-4bfe-b57a-a88adb5c990b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83549b4c-230c-4c43-ba2f-1c7e1b7607df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:37 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Volume volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 (fbff6eb4-e4f1-4722-aeb4-516a0d673488): created successfully Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83549b4c-230c-4c43-ba2f-1c7e1b7607df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Flow 'volume_create_manager' (685f7672-b606-47a0-ba9e-b5775afaaa5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-321d3441-d4fd-45fa-a84a-d3cedde18cb8 tempest-VolumesActionsTest-1538152409 None] Created volume successfully. Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Flow 'volume_create_manager' (2844bb32-8ad0-4fb3-a047-65a0d7e15f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4908952a-d069-47fb-9e00-31500348df33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4908952a-d069-47fb-9e00-31500348df33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1156872466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe28912-3ea5-4d0f-a807-d43130746858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2d1a89b06d47f38afb4448b33ef5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:42Z,use_quota=True,user_id='16694c6ae6ca47d88c6dc808271271db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e9cc59-f327-487d-84bf-affe79a00c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e9cc59-f327-487d-84bf-affe79a00c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81ac798-3587-4c23-83e6-3e4a9ec95ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81ac798-3587-4c23-83e6-3e4a9ec95ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe28912-3ea5-4d0f-a807-d43130746858', 'volume_name': 'volume-ffe28912-3ea5-4d0f-a807-d43130746858', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddca760-3680-4cb1-ae82-2fa5749de887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddca760-3680-4cb1-ae82-2fa5749de887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4146c2-65ca-4c80-928e-1eae510b04e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Volume ffe28912-3ea5-4d0f-a807-d43130746858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe28912-3ea5-4d0f-a807-d43130746858', 'volume_size': 1} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1156872466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe28912-3ea5-4d0f-a807-d43130746858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2d1a89b06d47f38afb4448b33ef5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:42Z,use_quota=True,user_id='16694c6ae6ca47d88c6dc808271271db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Creating volume ffe28912-3ea5-4d0f-a807-d43130746858 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:42 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:45:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:42 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 1073741824 Sep 25 11:45:42 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:43 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 1073741824" returned: 0 in 0.639s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:43 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 Sep 25 11:45:43 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:43 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858" returned: 0 in 0.337s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4146c2-65ca-4c80-928e-1eae510b04e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe28912-3ea5-4d0f-a807-d43130746858', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309e7db1-3005-4140-a307-098365757e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:43 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Volume volume-ffe28912-3ea5-4d0f-a807-d43130746858 (ffe28912-3ea5-4d0f-a807-d43130746858): created successfully Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309e7db1-3005-4140-a307-098365757e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Flow 'volume_create_manager' (2844bb32-8ad0-4fb3-a047-65a0d7e15f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:43 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c788c04d-a270-460c-b364-40a13c77080c tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Created volume successfully. Sep 25 11:45:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8278b650-2c82-40fa-9140-4277e1b9b590 req-9943785a-3a6b-4cc4-b0cd-0988ef581471 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8278b650-2c82-40fa-9140-4277e1b9b590 req-9943785a-3a6b-4cc4-b0cd-0988ef581471 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-8278b650-2c82-40fa-9140-4277e1b9b590 req-9943785a-3a6b-4cc4-b0cd-0988ef581471 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-8278b650-2c82-40fa-9140-4277e1b9b590 req-9943785a-3a6b-4cc4-b0cd-0988ef581471 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-ffe28912-3ea5-4d0f-a807-d43130746858', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87b76aa7-c47b-4665-9426-2f78b627d094', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:45:46 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-8278b650-2c82-40fa-9140-4277e1b9b590 req-9943785a-3a6b-4cc4-b0cd-0988ef581471 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] attachment_update completed successfully. Sep 25 11:45:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4d864d8d-7cf0-42e0-b066-4ff7ee4f4bcb tempest-GroupsV314Test-1446534384 None] Group tempest-GroupsV314Test-Group-1765562552: creating Sep 25 11:45:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4d864d8d-7cf0-42e0-b066-4ff7ee4f4bcb tempest-GroupsV314Test-1446534384 None] Group tempest-GroupsV314Test-Group-1765562552: created successfully Sep 25 11:45:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4d864d8d-7cf0-42e0-b066-4ff7ee4f4bcb tempest-GroupsV314Test-1446534384 None] Create group completed successfully. Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=73,cinder:INSERT=22,cinder:UPDATE=67,cinder:DELETE=7 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=78,cinder:SELECT=63,cinder:DELETE=3,cinder:INSERT=11 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Flow 'volume_create_manager' (072b3708-5439-4013-bfb2-62aac5f3a11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6751855-d4d1-4ea8-8d8b-9e13c82e400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6751855-d4d1-4ea8-8d8b-9e13c82e400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1761738455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4c91792-5e75-41c7-aca7-372aefedf310,host='devstack@QuobyteHD#QuobyteHD',id=de1dcc8e-02c9-48ce-b9ef-e089b9a23085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff5531f39fb40a9a67c72a80f4c4f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:49Z,use_quota=True,user_id='ce736c1bb265498e8895c114e1b36ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ceb673e-c35f-48fd-af37-0172d323896f),volume_type_id=5ceb673e-c35f-48fd-af37-0172d323896f)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de86120c-6053-40d2-b7f4-c909677d46cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de86120c-6053-40d2-b7f4-c909677d46cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a90c92-59fa-460f-a2f6-81692bc52e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a90c92-59fa-460f-a2f6-81692bc52e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1dcc8e-02c9-48ce-b9ef-e089b9a23085', 'volume_name': 'volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe848cc-8720-4914-a882-014a36adfa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe848cc-8720-4914-a882-014a36adfa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbcdf3e-3421-4a2c-be28-bdef7ff9be19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Volume de1dcc8e-02c9-48ce-b9ef-e089b9a23085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085', 'volume_size': 1} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c4c91792-5e75-41c7-aca7-372aefedf310,created_at=2026-09-25T09:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1761738455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4c91792-5e75-41c7-aca7-372aefedf310,host='devstack@QuobyteHD#QuobyteHD',id=de1dcc8e-02c9-48ce-b9ef-e089b9a23085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff5531f39fb40a9a67c72a80f4c4f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:49Z,use_quota=True,user_id='ce736c1bb265498e8895c114e1b36ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ceb673e-c35f-48fd-af37-0172d323896f),volume_type_id=5ceb673e-c35f-48fd-af37-0172d323896f)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Creating volume de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:49 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:49 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 1073741824 Sep 25 11:45:49 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eadffb53-a4cd-4f7b-9ee2-5472853d9e79 tempest-VolumesActionsTest-1538152409 None] Acquiring lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488" by "attach_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eadffb53-a4cd-4f7b-9ee2-5472853d9e79 tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488" acquired by "attach_volume" :: waited 0.057s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-eadffb53-a4cd-4f7b-9ee2-5472853d9e79 tempest-VolumesActionsTest-1538152409 None] Attaching volume fbff6eb4-e4f1-4722-aeb4-516a0d673488 to instance 8245c894-83e6-4d25-8490-8d3a87cd27ab at mountpoint /dev/vdb on host None. Sep 25 11:45:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-eadffb53-a4cd-4f7b-9ee2-5472853d9e79 tempest-VolumesActionsTest-1538152409 None] Attach volume completed successfully. Sep 25 11:45:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eadffb53-a4cd-4f7b-9ee2-5472853d9e79 tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488" released by "attach_volume" :: held 0.181s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3906e68a-b681-4123-8880-cad9584f8231 tempest-VolumesActionsTest-1538152409 None] Acquiring lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-detach_volume" by "detach_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3906e68a-b681-4123-8880-cad9584f8231 tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3906e68a-b681-4123-8880-cad9584f8231 tempest-VolumesActionsTest-1538152409 None] Detaching volume fbff6eb4-e4f1-4722-aeb4-516a0d673488 from instance 8245c894-83e6-4d25-8490-8d3a87cd27ab. Sep 25 11:45:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3906e68a-b681-4123-8880-cad9584f8231 tempest-VolumesActionsTest-1538152409 None] Detach volume completed successfully. Sep 25 11:45:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3906e68a-b681-4123-8880-cad9584f8231 tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:50 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 1073741824" returned: 0 in 0.846s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:50 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 Sep 25 11:45:50 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:51 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-a3bcce7d-5cd0-488a-aa3c-7d30814a28d4 req-518e7cb4-617e-4223-9483-f90a128d29e8 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Terminate volume connection completed successfully. Sep 25 11:45:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-a3bcce7d-5cd0-488a-aa3c-7d30814a28d4 req-518e7cb4-617e-4223-9483-f90a128d29e8 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Deleting attachment 87b76aa7-c47b-4665-9426-2f78b627d094. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:45:51 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" returned: 0 in 0.521s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbcdf3e-3421-4a2c-be28-bdef7ff9be19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f9374c-59f2-4df6-bf0a-a76b41cbe386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:51 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Volume volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 (de1dcc8e-02c9-48ce-b9ef-e089b9a23085): created successfully Sep 25 11:45:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f9374c-59f2-4df6-bf0a-a76b41cbe386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Flow 'volume_create_manager' (072b3708-5439-4013-bfb2-62aac5f3a11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:51 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ccbb847b-fe13-4e4d-b9fc-d8880b5624d7 tempest-GroupsV314Test-1446534384 None] Created volume successfully. Sep 25 11:45:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Acquiring lock "cinder-ffe28912-3ea5-4d0f-a807-d43130746858-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "cinder-ffe28912-3ea5-4d0f-a807-d43130746858-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Acquiring lock "cinder-quobyte-ffe28912-3ea5-4d0f-a807-d43130746858" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "cinder-quobyte-ffe28912-3ea5-4d0f-a807-d43130746858" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bdb84a-59c1-4485-995e-e070b054abdc]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:53 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 Sep 25 11:45:53 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:53 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Cloning volume de1dcc8e-02c9-48ce-b9ef-e089b9a23085 to volume 36abc440-7d06-405d-a442-916fcaeaf6fc Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Creating offline snapshot f450d6f5-959c-4811-a626-d69c5a9a5c4a of volume de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84596b7-a05f-4410-8a73-c15feda6b62c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:53 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 Sep 25 11:45:53 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:53 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858" returned: 0 in 0.729s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:53 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858 Sep 25 11:45:53 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:53 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:53 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" returned: 0 in 0.653s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ffe28912-3ea5-4d0f-a807-d43130746858" returned: 0 in 0.357s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:53 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a 1G Sep 25 11:45:53 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "cinder-quobyte-ffe28912-3ea5-4d0f-a807-d43130746858" released by "delete_volume" :: held 1.173s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Created reservations ['3ef93823-f03f-4485-9c85-3fad89cb7b32', '20f192fa-05eb-4e40-bbde-44edebb91930', 'c93b8469-a3a9-4b46-a236-522f8db0fa49', 'f5af17f8-df1e-4ad4-8f66-7b36154ad8cf'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:54 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:45:54 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:54 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a 1G" returned: 0 in 0.577s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:54 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.362s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:54 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a Sep 25 11:45:54 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Deleted volume successfully. Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0c6dea25-da54-4ad1-a651-dfead2d9de62 tempest-TestServerVolumeAttachScenarioOldVersion-1899794832 None] Lock "cinder-ffe28912-3ea5-4d0f-a807-d43130746858-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:54 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a" returned: 0 in 0.398s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:54 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:45:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:54 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a Sep 25 11:45:54 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:55 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a" returned: 0 in 0.461s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:55 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.info Sep 25 11:45:55 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:55 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.info" returned: 0 in 0.380s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:55 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:45:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:55 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.info Sep 25 11:45:55 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:56 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.info" returned: 0 in 0.663s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Acquiring lock "cinder-quobyte-36abc440-7d06-405d-a442-916fcaeaf6fc" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Lock "cinder-quobyte-36abc440-7d06-405d-a442-916fcaeaf6fc" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] snapshot: f450d6f5-959c-4811-a626-d69c5a9a5c4a, volume: 36abc440-7d06-405d-a442-916fcaeaf6fc, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[416c0b35-fe51-418c-8014-7d0e3be47e1e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:56 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a Sep 25 11:45:56 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:57 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a" returned: 0 in 0.685s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:57 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc37e26-81e4-4658-bcf3-059bee904b1b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:57 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 Sep 25 11:45:57 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:58 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" returned: 0 in 0.670s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:45:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:45:58 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:45:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:58 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc Sep 25 11:45:58 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:05 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:INSERT=5,cinder:SELECT=18,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:46:05 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=21,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:46:09 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc" returned: 0 in 11.469s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085, size 1024.00 MB, duration 11.47 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:46:09 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Converted 1024.00 MB image at 89.27 MB/s Sep 25 11:46:09 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:09 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc Sep 25 11:46:09 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:09 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc" returned: 0 in 0.337s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Lock "cinder-quobyte-36abc440-7d06-405d-a442-916fcaeaf6fc" released by "_copy_volume_from_snapshot" :: held 13.309s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Acquiring lock "cinder-quobyte-f450d6f5-959c-4811-a626-d69c5a9a5c4a" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5695059c-27e4-45be-8e18-a8afddbdfd22 tempest-VolumesActionsTest-1538152409 None] Acquiring lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488" by "attach_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Lock "cinder-quobyte-f450d6f5-959c-4811-a626-d69c5a9a5c4a" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Deleting offline snapshot f450d6f5-959c-4811-a626-d69c5a9a5c4a of volume de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] snapshot_file for this snap is: volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa0dc92-bcbf-4be5-a7a7-55f24ef8cd32]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5695059c-27e4-45be-8e18-a8afddbdfd22 tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488" acquired by "attach_volume" :: waited 0.088s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5695059c-27e4-45be-8e18-a8afddbdfd22 tempest-VolumesActionsTest-1538152409 None] Attaching volume fbff6eb4-e4f1-4722-aeb4-516a0d673488 to instance 742b312c-62ae-4ef2-b995-2195ff1304d6 at mountpoint /dev/vdb on host None. Sep 25 11:46:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5695059c-27e4-45be-8e18-a8afddbdfd22 tempest-VolumesActionsTest-1538152409 None] Attach volume completed successfully. Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-5695059c-27e4-45be-8e18-a8afddbdfd22 tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488" released by "attach_volume" :: held 0.172s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:10 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a Sep 25 11:46:10 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:10 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a" returned: 0 in 0.693s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[046969b9-c8db-46ca-b628-cdaac67f73b4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a2ecbc11-23d2-41a9-83dc-7a9810c80de0 tempest-VolumesActionsTest-1538152409 None] Acquiring lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-detach_volume" by "detach_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a2ecbc11-23d2-41a9-83dc-7a9810c80de0 tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a2ecbc11-23d2-41a9-83dc-7a9810c80de0 tempest-VolumesActionsTest-1538152409 None] Detaching volume fbff6eb4-e4f1-4722-aeb4-516a0d673488 from instance 742b312c-62ae-4ef2-b995-2195ff1304d6. Sep 25 11:46:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a2ecbc11-23d2-41a9-83dc-7a9810c80de0 tempest-VolumesActionsTest-1538152409 None] Detach volume completed successfully. Sep 25 11:46:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a2ecbc11-23d2-41a9-83dc-7a9810c80de0 tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:11 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 Sep 25 11:46:11 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:11 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" returned: 0 in 0.994s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:11 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a Sep 25 11:46:11 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:12 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a" returned: 0 in 0.650s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:12 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a Sep 25 11:46:12 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:12 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085.f450d6f5-959c-4811-a626-d69c5a9a5c4a" returned: 0 in 0.438s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Lock "cinder-quobyte-f450d6f5-959c-4811-a626-d69c5a9a5c4a" released by "_delete_snapshot" :: held 3.002s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.841s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-11cf4201-b60a-4f1d-b708-dfd1a79c3069 tempest-GroupsV314Test-1446534384 None] Create group from source-group-c4c91792-5e75-41c7-aca7-372aefedf310 completed successfully. Sep 25 11:46:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Acquiring lock "cinder-quobyte-36abc440-7d06-405d-a442-916fcaeaf6fc" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Lock "cinder-quobyte-36abc440-7d06-405d-a442-916fcaeaf6fc" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:15 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c8ca3-e95c-4801-b618-7e24cedb7e42]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:15 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc Sep 25 11:46:15 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:15 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc" returned: 0 in 0.592s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:15 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc Sep 25 11:46:15 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:16 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-36abc440-7d06-405d-a442-916fcaeaf6fc" returned: 0 in 0.368s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Lock "cinder-quobyte-36abc440-7d06-405d-a442-916fcaeaf6fc" released by "delete_volume" :: held 1.032s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Created reservations ['55198a41-53da-4b3d-ba29-42c3ea0b8663'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:16 devstack cinder-volume[87356]: WARNING cinder.quota [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1625076098 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1625076098, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:16 devstack cinder-volume[87356]: WARNING cinder.quota [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1625076098 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1625076098, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Created reservations ['f78dcc0d-6fb9-43f6-aa4b-b90ff71df18d', 'fe00670d-cba7-44ff-a108-5f22bafa58a1', 'ad36bca6-9b1c-4498-83a6-56212d5b0951', 'd6bb3841-2dc4-426d-8af7-267c6afca7f6'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:16 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:46:16 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:16 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.341s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:16 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4d535e7e-55a7-4b3a-833d-6a8cf039c050 tempest-GroupsV314Test-1446534384 None] Delete group completed successfully. Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab9a74-c0ba-4b9f-b11b-8c70d0913e94]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:17 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:46:17 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:17 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.522s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc99f81-7f29-47b3-863b-5eb6813454a0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:17 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:46:17 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Acquiring lock "cinder-quobyte-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Lock "cinder-quobyte-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:18 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd054be-45a8-4b6b-b6a7-99342ff4b56e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:18 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.487s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.ea4f569e-6818-4796-a34c-beb28e6e1bb7eabywg1l.img {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:18 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 Sep 25 11:46:18 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:18 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.ea4f569e-6818-4796-a34c-beb28e6e1bb7eabywg1l.img Sep 25 11:46:18 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:18 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" returned: 0 in 0.559s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:18 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085 Sep 25 11:46:18 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:19 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" returned: 0 in 0.665s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Lock "cinder-quobyte-de1dcc8e-02c9-48ce-b9ef-e089b9a23085" released by "delete_volume" :: held 1.342s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:19 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Created reservations ['cc67973c-9407-42f5-b276-53245fd53e9c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:19 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Created reservations ['0de27830-32cc-4c7a-8edd-4a79aa6b405e', '07f8a053-ada6-41b7-b0cc-e218cccc429f', '20e11230-2d10-48e3-882b-5787e60a6e4f', '29903b95-2f0e-43c5-93a4-0d02c053289c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:20 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:46:20 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:20 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.552s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:20 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:20 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-75936b8f-e84b-4c1c-97ea-22a7f7669fac tempest-GroupsV314Test-1446534384 None] Delete group completed successfully. Sep 25 11:46:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:46:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:23 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:46:23 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:24 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.737s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:24 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:24 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:46:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:46:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:46:27 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.ea4f569e-6818-4796-a34c-beb28e6e1bb7eabywg1l.img" returned: 0 in 9.530s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:27 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[369eda6c-3cfa-4448-bc6e-cfc08fb704b3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:27 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:46:27 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:28 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.807s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:28 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488, size 1024.00 MB, duration 9.53 sec, destination /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.ea4f569e-6818-4796-a34c-beb28e6e1bb7eabywg1l.img {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:46:28 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Converted 1024.00 MB image at 107.44 MB/s Sep 25 11:46:28 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] ea4f569e-6818-4796-a34c-beb28e6e1bb7 was raw, no need to convert to raw {{(pid=87356) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 11:46:38 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=27,cinder:UPDATE=22,cinder:INSERT=6 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:46:38 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=33,cinder:SELECT=25,cinder:INSERT=6 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:46:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 40.538s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Uploaded volume to glance image-id: ea4f569e-6818-4796-a34c-beb28e6e1bb7. {{(pid=87356) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 11:46:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-06b7f94f-1f70-43aa-8acf-ae893575c2dd tempest-VolumesActionsTest-1538152409 None] Copy volume to image completed successfully. Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Flow 'volume_create_manager' (6d117718-a03f-40a2-98f7-09f978fad481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65217df6-334a-4d5a-a268-14b3e7d52718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65217df6-334a-4d5a-a268-14b3e7d52718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1720632445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b2c541-9f55-46b2-8e31-fb9c008bc206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45af076ec7ba4c1cb968d1bfc4d2ba4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:58Z,use_quota=True,user_id='cd0168062ea445c4b6074db6a520bd3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(274be3a3-dcba-462f-895b-cdc815394135),volume_type_id=274be3a3-dcba-462f-895b-cdc815394135)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d06ef1-3361-4035-8c61-96e83ccf9df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d06ef1-3361-4035-8c61-96e83ccf9df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc22fab6-9643-4b9b-9cd4-851cab863997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc22fab6-9643-4b9b-9cd4-851cab863997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b2c541-9f55-46b2-8e31-fb9c008bc206', 'volume_name': 'volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58afc9ac-0ac9-4024-9f66-90affae74233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58afc9ac-0ac9-4024-9f66-90affae74233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720c5bda-c22a-40f6-b0c6-db4db1f22dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:58 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Volume c2b2c541-9f55-46b2-8e31-fb9c008bc206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206', 'volume_size': 1} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1720632445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b2c541-9f55-46b2-8e31-fb9c008bc206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45af076ec7ba4c1cb968d1bfc4d2ba4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:58Z,use_quota=True,user_id='cd0168062ea445c4b6074db6a520bd3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(274be3a3-dcba-462f-895b-cdc815394135),volume_type_id=274be3a3-dcba-462f-895b-cdc815394135)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Creating volume c2b2c541-9f55-46b2-8e31-fb9c008bc206 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:58 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:46:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:58 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 1073741824 Sep 25 11:46:58 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:59 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 1073741824" returned: 0 in 0.901s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:59 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 Sep 25 11:46:59 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:00 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206" returned: 0 in 0.478s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720c5bda-c22a-40f6-b0c6-db4db1f22dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f623f7-7472-4606-bccc-cfee74bbf56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Volume volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 (c2b2c541-9f55-46b2-8e31-fb9c008bc206): created successfully Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f623f7-7472-4606-bccc-cfee74bbf56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Flow 'volume_create_manager' (6d117718-a03f-40a2-98f7-09f978fad481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-be70507d-d2b2-4e1a-a040-65005c935d2d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Created volume successfully. Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe01338-369f-4c3a-b89e-cdd5a7c23ce7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:00 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:47:00 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:01 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.667s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd16ab76-7e1c-452e-aef9-da0b4012411a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:01 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:47:01 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:01 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Flow 'volume_create_manager' (5fdfdeea-f61d-421f-beb6-a0dd56ea9d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce0c505-0cc4-4c6c-91f2-a5f33c3af891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.603s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce0c505-0cc4-4c6c-91f2-a5f33c3af891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-884586222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb0d376-2fa6-425e-8b92-9e10bee5fd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7306bdebede14de08010be12306ada70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:01Z,use_quota=True,user_id='0f9c4e5643404c04af927f6c2f4fd883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903a31b3-e8a3-4196-b056-fdbc24b71da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:01 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903a31b3-e8a3-4196-b056-fdbc24b71da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:01 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f4891b-7ace-4bab-a5f9-870496103c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f4891b-7ace-4bab-a5f9-870496103c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb0d376-2fa6-425e-8b92-9e10bee5fd32', 'volume_name': 'volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6475fe2b-47a0-48a9-a2bc-97fd5557cebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6475fe2b-47a0-48a9-a2bc-97fd5557cebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3768b3c4-dadd-4c1d-8c38-af48852e4198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Volume deb0d376-2fa6-425e-8b92-9e10bee5fd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32', 'volume_size': 1} Sep 25 11:47:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:02 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:47:02 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Flow 'volume_create_manager' (cae974d4-5ec0-45cc-80b2-18afb5d0446b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d316a366-9111-4ca6-9bf3-ea247da2bc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d316a366-9111-4ca6-9bf3-ea247da2bc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1787077910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af5a569-a67c-4ab8-9f6f-b227c8da24a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7306bdebede14de08010be12306ada70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:02Z,use_quota=True,user_id='0f9c4e5643404c04af927f6c2f4fd883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea3c437-d4c3-4a0e-a10e-0ee9acb9540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea3c437-d4c3-4a0e-a10e-0ee9acb9540a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f1c16e-8580-4c51-87c5-9bf976eca4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f1c16e-8580-4c51-87c5-9bf976eca4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af5a569-a67c-4ab8-9f6f-b227c8da24a2', 'volume_name': 'volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b99268f-789a-426c-8a9c-2a3a27d6d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b99268f-789a-426c-8a9c-2a3a27d6d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adaa354-bfde-4038-a9b6-70cb7822c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:02 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Volume 1af5a569-a67c-4ab8-9f6f-b227c8da24a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2', 'volume_size': 1} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:02 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.692s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:02 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:02 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-feeb35cd-ef09-4e45-afd8-7c157596c63d tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Retype volume completed successfully. Sep 25 11:47:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Acquiring lock "cinder-c2b2c541-9f55-46b2-8e31-fb9c008bc206-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "cinder-c2b2c541-9f55-46b2-8e31-fb9c008bc206-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Acquiring lock "cinder-quobyte-c2b2c541-9f55-46b2-8e31-fb9c008bc206" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "cinder-quobyte-c2b2c541-9f55-46b2-8e31-fb9c008bc206" acquired by "delete_volume" :: waited 0.054s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:04 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7318f86b-8302-4178-b51e-5d70a19e290d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:05 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 Sep 25 11:47:05 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:05 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206" returned: 0 in 0.934s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:05 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206 Sep 25 11:47:05 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:06 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c2b2c541-9f55-46b2-8e31-fb9c008bc206" returned: 0 in 0.571s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "cinder-quobyte-c2b2c541-9f55-46b2-8e31-fb9c008bc206" released by "delete_volume" :: held 1.637s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:06 devstack cinder-volume[87356]: WARNING cinder.quota [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:47:06 devstack cinder-volume[87356]: WARNING cinder.quota [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Created reservations ['c42dbf1b-e301-4405-8eff-c3edca3f19b2', '50c7d973-2551-41ef-a61c-8f300c3bfa8f', '8b09d01c-b249-412c-ba8c-32be099da0d6', '8913f8bb-7e54-427d-8d6d-5ce0bcbe04f4'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:06 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:47:06 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:07 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.781s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:07 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Deleted volume successfully. Sep 25 11:47:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8ef0e10c-0404-4cd9-bee6-ad5c0d6153f9 tempest-VolumeRetypeWithoutMigrationTest-1899171116 None] Lock "cinder-c2b2c541-9f55-46b2-8e31-fb9c008bc206-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:11 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img" returned: 0 in 9.559s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d9b0b9-1c7a-4058-bc8d-b66c8671ebcb]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:11 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:47:11 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:12 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.849s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:12 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488, size 1024.00 MB, duration 9.56 sec, destination /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:47:12 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Converted 1024.00 MB image at 107.11 MB/s Sep 25 11:47:12 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] 45e6b4f8-0962-4c3c-ba6e-6d98196baf30 was raw, converting to qcow2 {{(pid=87356) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 11:47:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f1783a-d413-4573-866b-ab6147942a35]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:12 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img Sep 25 11:47:12 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:12 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img" returned: 0 in 0.529s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:12 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img Sep 25 11:47:12 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:13 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img" returned: 1 in 0.475s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:47:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img /opt/stack/data/cinder/conversion/vol_upload_97ugm0j6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:13 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img /opt/stack/data/cinder/conversion/vol_upload_97ugm0j6 Sep 25 11:47:13 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:13 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img /opt/stack/data/cinder/conversion/vol_upload_97ugm0j6" returned: 0 in 0.371s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:13 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Image conversion details: src /opt/stack/data/cinder/conversion/fbff6eb4-e4f1-4722-aeb4-516a0d673488.temp_image.45e6b4f8-0962-4c3c-ba6e-6d98196baf304wc0mzqw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_97ugm0j6 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:47:13 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 11:47:13 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6440449-abc4-4435-8ce2-f4712f68d99d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_97ugm0j6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:13 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_97ugm0j6 Sep 25 11:47:13 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:14 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_97ugm0j6" returned: 0 in 0.490s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.713s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Uploaded volume to glance image-id: 45e6b4f8-0962-4c3c-ba6e-6d98196baf30. {{(pid=87356) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.228s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-884586222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb0d376-2fa6-425e-8b92-9e10bee5fd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7306bdebede14de08010be12306ada70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:01Z,use_quota=True,user_id='0f9c4e5643404c04af927f6c2f4fd883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Creating volume deb0d376-2fa6-425e-8b92-9e10bee5fd32 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:16 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6dade938-480d-43e9-9a3b-4ba90bf86d10 tempest-VolumesActionsTest-1538152409 None] Copy volume to image completed successfully. Sep 25 11:47:16 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 1073741824 Sep 25 11:47:16 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:16 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 1073741824" returned: 0 in 0.825s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:17 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 Sep 25 11:47:17 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:17 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32" returned: 0 in 0.592s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.096s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1787077910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af5a569-a67c-4ab8-9f6f-b227c8da24a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7306bdebede14de08010be12306ada70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:02Z,use_quota=True,user_id='0f9c4e5643404c04af927f6c2f4fd883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Creating volume 1af5a569-a67c-4ab8-9f6f-b227c8da24a2 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:17 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Acquiring lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:17 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 1073741824 Sep 25 11:47:17 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3768b3c4-dadd-4c1d-8c38-af48852e4198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411f90b5-5033-4fe6-bb86-c5c71bd01c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:17 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Volume volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 (deb0d376-2fa6-425e-8b92-9e10bee5fd32): created successfully Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411f90b5-5033-4fe6-bb86-c5c71bd01c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Flow 'volume_create_manager' (5fdfdeea-f61d-421f-beb6-a0dd56ea9d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-09534be6-4f58-400f-8c00-ef83813d2781 tempest-TestServerVolumeAttachmentScenario-369849265 None] Created volume successfully. Sep 25 11:47:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Acquiring lock "cinder-quobyte-fbff6eb4-e4f1-4722-aeb4-516a0d673488" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Lock "cinder-quobyte-fbff6eb4-e4f1-4722-aeb4-516a0d673488" acquired by "delete_volume" :: waited 0.046s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:18 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f5e53-82de-4dec-8a8a-99b98030e6b7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:18 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:47:18 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:18 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 1073741824" returned: 0 in 1.100s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:18 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.870s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:19 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 Sep 25 11:47:19 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:19 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488 Sep 25 11:47:19 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Flow 'volume_create_manager' (6c67db1d-4b0a-40f5-b839-f8f0d4cba721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:19 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867ca7db-fdf4-4796-ae70-079999d2737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fbff6eb4-e4f1-4722-aeb4-516a0d673488" returned: 0 in 0.377s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:19 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2" returned: 0 in 0.459s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Lock "cinder-quobyte-fbff6eb4-e4f1-4722-aeb4-516a0d673488" released by "delete_volume" :: held 1.353s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867ca7db-fdf4-4796-ae70-079999d2737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1479683522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30b0041-3a95-4bec-99b7-c6414735e97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6434a0904734b20a9dfcee0180e1830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:19Z,use_quota=True,user_id='cef291e68f1f4b32bfbfbc418799d3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2ccb81d-5e42-42ee-aea8-42893cc0bdf6),volume_type_id=b2ccb81d-5e42-42ee-aea8-42893cc0bdf6)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb87710-92c4-4a7e-8930-5bf97d218e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb87710-92c4-4a7e-8930-5bf97d218e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349d1e53-131e-49fd-b70d-13cb8dd7510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349d1e53-131e-49fd-b70d-13cb8dd7510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30b0041-3a95-4bec-99b7-c6414735e97c', 'volume_name': 'volume-f30b0041-3a95-4bec-99b7-c6414735e97c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b711a586-09a2-4f4e-8cfc-cefc2653c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b711a586-09a2-4f4e-8cfc-cefc2653c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f111d5a1-60f5-400e-86e9-825645d69286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Volume f30b0041-3a95-4bec-99b7-c6414735e97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30b0041-3a95-4bec-99b7-c6414735e97c', 'volume_size': 1} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1479683522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30b0041-3a95-4bec-99b7-c6414735e97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6434a0904734b20a9dfcee0180e1830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:19Z,use_quota=True,user_id='cef291e68f1f4b32bfbfbc418799d3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2ccb81d-5e42-42ee-aea8-42893cc0bdf6),volume_type_id=b2ccb81d-5e42-42ee-aea8-42893cc0bdf6)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Creating volume f30b0041-3a95-4bec-99b7-c6414735e97c {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:19 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:19 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c 1073741824 Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adaa354-bfde-4038-a9b6-70cb7822c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8e06ec-d7dd-49ba-9c4a-b588c66608bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Volume volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 (1af5a569-a67c-4ab8-9f6f-b227c8da24a2): created successfully Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8e06ec-d7dd-49ba-9c4a-b588c66608bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Flow 'volume_create_manager' (cae974d4-5ec0-45cc-80b2-18afb5d0446b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:19 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-627a8e2b-4dec-40c3-a694-32a09e0844e8 tempest-TestServerVolumeAttachmentScenario-369849265 None] Created volume successfully. Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Created reservations ['46fd19b3-9afd-4443-add2-7144d1698fa9', '108c7471-a9bd-44bc-90ba-c7d689b43d9a', 'bf2f9bc6-e0f9-472d-9361-8dbbbd36f396', '309ad367-4246-49d5-bd34-2e6d0ee08dcd'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:19 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:47:19 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:20 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c 1073741824" returned: 0 in 0.607s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:20 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.370s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:20 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Deleted volume successfully. Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e8f18fac-61e3-4c9e-b8ff-c7088ea4f1ca tempest-VolumesActionsTest-1538152409 None] Lock "cinder-fbff6eb4-e4f1-4722-aeb4-516a0d673488-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:20 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c Sep 25 11:47:20 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:20 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c" returned: 0 in 0.331s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f111d5a1-60f5-400e-86e9-825645d69286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30b0041-3a95-4bec-99b7-c6414735e97c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b527b97-15a2-4b51-ae96-7d51cc3b0341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Volume volume-f30b0041-3a95-4bec-99b7-c6414735e97c (f30b0041-3a95-4bec-99b7-c6414735e97c): created successfully Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b527b97-15a2-4b51-ae96-7d51cc3b0341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Flow 'volume_create_manager' (6c67db1d-4b0a-40f5-b839-f8f0d4cba721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:20 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-83a735bf-7535-4cd9-860b-6805403f67f3 tempest-VolumeTypesAccessTest-1932992871 None] Created volume successfully. Sep 25 11:47:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Acquiring lock "cinder-f30b0041-3a95-4bec-99b7-c6414735e97c-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Lock "cinder-f30b0041-3a95-4bec-99b7-c6414735e97c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Acquiring lock "cinder-quobyte-f30b0041-3a95-4bec-99b7-c6414735e97c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Lock "cinder-quobyte-f30b0041-3a95-4bec-99b7-c6414735e97c" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:21 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc4c00-fc66-42ab-bf08-1cb2ae36cdb4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:21 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c Sep 25 11:47:21 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:22 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c" returned: 0 in 0.489s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:22 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c Sep 25 11:47:22 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:22 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f30b0041-3a95-4bec-99b7-c6414735e97c" returned: 0 in 0.461s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Lock "cinder-quobyte-f30b0041-3a95-4bec-99b7-c6414735e97c" released by "delete_volume" :: held 1.055s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:22 devstack cinder-volume[87356]: WARNING cinder.quota [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-579405114 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-579405114, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:47:22 devstack cinder-volume[87356]: WARNING cinder.quota [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-579405114 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-579405114, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Created reservations ['a6dff05c-6c39-4e1d-87d8-1c480e84c228', 'a0a88f20-1a39-4bbe-bbc0-ba4adcf20eb0', 'df8ee32f-7b14-400a-9c6d-48edc6cf5a25', 'f10c85d0-613d-43cf-b8a5-6c2dc7683ded'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:23 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:47:23 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:23 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:47:23 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:23 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.629s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:24 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:24 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:47:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:47:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:47:24 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 1.014s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:24 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:24 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Deleted volume successfully. Sep 25 11:47:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-482e94d1-b437-4a5d-b166-68c2dcede5d2 tempest-VolumeTypesAccessTest-1932992871 None] Lock "cinder-f30b0041-3a95-4bec-99b7-c6414735e97c-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Flow 'volume_create_manager' (b75d4389-73e0-4445-92c3-b341be0dccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe6e0c3-f0d1-4f02-b997-b3d773950bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe6e0c3-f0d1-4f02-b997-b3d773950bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1048272679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc19c1e7-811c-440c-8bf8-38fd55c9c55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ae374d10514e1c8a42f49eaf8c3c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:32Z,use_quota=True,user_id='851bb7da508c4d32817f11d89ac42013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ec4c0d-a03c-43fa-ae7c-19d56fc1d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ec4c0d-a03c-43fa-ae7c-19d56fc1d481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd69a0a-d8da-405e-bed9-af6142fe2573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd69a0a-d8da-405e-bed9-af6142fe2573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc19c1e7-811c-440c-8bf8-38fd55c9c55a', 'volume_name': 'volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe69a567-437b-4677-b0b8-d793ff1809d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe69a567-437b-4677-b0b8-d793ff1809d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f2a57c-e18e-4450-85cb-468591307a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:32 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Volume bc19c1e7-811c-440c-8bf8-38fd55c9c55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a', 'volume_size': 1} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1048272679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc19c1e7-811c-440c-8bf8-38fd55c9c55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ae374d10514e1c8a42f49eaf8c3c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:32Z,use_quota=True,user_id='851bb7da508c4d32817f11d89ac42013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Creating volume bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:32 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:32 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a 1073741824 Sep 25 11:47:32 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:32 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a 1073741824" returned: 0 in 0.574s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:32 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a Sep 25 11:47:32 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:33 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" returned: 0 in 0.331s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f2a57c-e18e-4450-85cb-468591307a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1476d5d3-c8d8-4abb-ba65-0b15763204dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:33 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Volume volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a (bc19c1e7-811c-440c-8bf8-38fd55c9c55a): created successfully Sep 25 11:47:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1476d5d3-c8d8-4abb-ba65-0b15763204dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:33 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Flow 'volume_create_manager' (b75d4389-73e0-4445-92c3-b341be0dccb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:33 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-79cf516c-da25-49be-9b2f-fec9ea6e666c tempest-VolumesCloneTest-1258970184 None] Created volume successfully. Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Flow 'volume_create_manager' (89802a4c-4ef7-4766-be8e-354913fbead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4010a244-5db9-4548-9754-ce604e918d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4010a244-5db9-4548-9754-ce604e918d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-253804591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29512df-ca68-493a-ade7-bc6b4d190ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ae374d10514e1c8a42f49eaf8c3c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bc19c1e7-811c-440c-8bf8-38fd55c9c55a,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:35Z,use_quota=True,user_id='851bb7da508c4d32817f11d89ac42013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56528b4-ee72-4ecc-8fc7-346ad86d7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56528b4-ee72-4ecc-8fc7-346ad86d7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee04074-23d7-4b4c-a399-12b7b5ecd1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee04074-23d7-4b4c-a399-12b7b5ecd1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a29512df-ca68-493a-ade7-bc6b4d190ca7', 'volume_name': 'volume-a29512df-ca68-493a-ade7-bc6b4d190ca7', 'volume_size': 2, 'source_volid': 'bc19c1e7-811c-440c-8bf8-38fd55c9c55a', 'source_volstatus': 'available'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9563b4-5392-4750-b359-dfaed34da6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9563b4-5392-4750-b359-dfaed34da6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06739d6-65a2-4648-bcd5-1e6ff42abdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Volume a29512df-ca68-493a-ade7-bc6b4d190ca7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a29512df-ca68-493a-ade7-bc6b4d190ca7', 'volume_size': 2, 'source_volid': 'bc19c1e7-811c-440c-8bf8-38fd55c9c55a', 'source_volstatus': 'available'} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:35 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Cloning volume bc19c1e7-811c-440c-8bf8-38fd55c9c55a to volume a29512df-ca68-493a-ade7-bc6b4d190ca7 Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Creating offline snapshot 460b03e7-14e3-4c30-891e-7a6595e5927a of volume bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[782dc356-1450-47fd-b0af-b45235de6582]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:35 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a Sep 25 11:47:35 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:35 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" returned: 0 in 0.419s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:35 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a 1G Sep 25 11:47:35 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:36 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a 1G" returned: 0 in 0.549s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:36 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a Sep 25 11:47:36 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:36 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a" returned: 0 in 0.366s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:36 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a is being set with open permissions: ugo+rw Sep 25 11:47:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:36 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a Sep 25 11:47:36 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:36 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a" returned: 0 in 0.290s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:37 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.info Sep 25 11:47:37 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:37 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.info" returned: 0 in 0.329s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:37 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.info is being set with open permissions: ugo+rw Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:37 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.info Sep 25 11:47:37 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:37 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.info" returned: 0 in 0.382s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Acquiring lock "cinder-quobyte-a29512df-ca68-493a-ade7-bc6b4d190ca7" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Lock "cinder-quobyte-a29512df-ca68-493a-ade7-bc6b4d190ca7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] snapshot: 460b03e7-14e3-4c30-891e-7a6595e5927a, volume: a29512df-ca68-493a-ade7-bc6b4d190ca7, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3548e4a-050d-437b-b729-5aa1873d76ba]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:37 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a Sep 25 11:47:37 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:38 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a" returned: 0 in 0.492s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[393db908-bd86-4241-a3e5-b83000a78fd6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:38 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a Sep 25 11:47:38 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:38 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" returned: 0 in 0.439s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:47:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:38 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 Sep 25 11:47:38 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Flow 'volume_create_manager' (e4968be2-de24-45f0-99ef-97b1787970e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a09ded-86f6-4796-9d4a-f3470c713767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a09ded-86f6-4796-9d4a-f3470c713767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-545974714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f29119e-17bf-42a6-9fa6-e00a6e91b9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb92af2c5b8243d1adfcbeb74f048953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:42Z,use_quota=True,user_id='275efe58c729418d8affbde68c404304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352bfbde-9604-4e09-9823-caaf57336029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352bfbde-9604-4e09-9823-caaf57336029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca57c33-4d75-44b2-abe9-d8c258a5ff6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca57c33-4d75-44b2-abe9-d8c258a5ff6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f29119e-17bf-42a6-9fa6-e00a6e91b9b8', 'volume_name': 'volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d390322b-084b-47cc-8e8d-43bf01b50b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d390322b-084b-47cc-8e8d-43bf01b50b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b39ced1-191e-4cb8-bd42-5b94bb4a67c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Volume 9f29119e-17bf-42a6-9fa6-e00a6e91b9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8', 'volume_size': 1} Sep 25 11:47:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:46 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7" returned: 0 in 7.857s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:46 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a, size 1024.00 MB, duration 7.86 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:47:46 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Converted 1024.00 MB image at 130.30 MB/s Sep 25 11:47:46 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 is being set with open permissions: ugo+rw Sep 25 11:47:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:46 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 Sep 25 11:47:46 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:46 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7" returned: 0 in 0.332s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Lock "cinder-quobyte-a29512df-ca68-493a-ade7-bc6b4d190ca7" released by "_copy_volume_from_snapshot" :: held 9.210s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Acquiring lock "cinder-quobyte-460b03e7-14e3-4c30-891e-7a6595e5927a" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Lock "cinder-quobyte-460b03e7-14e3-4c30-891e-7a6595e5927a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Deleting offline snapshot 460b03e7-14e3-4c30-891e-7a6595e5927a of volume bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:47:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] snapshot_file for this snap is: volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:47:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c12346-335b-40ae-9b65-629a3abd4549]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:47 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a Sep 25 11:47:47 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-0b862a69-f1e0-4054-a38d-af7acc29f00f req-658d7520-c90d-430b-a6c0-76a40c64d87f tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:47 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a" returned: 0 in 0.447s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:47:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3218092-2d11-480b-9822-1b6890c973c7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:47 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a Sep 25 11:47:47 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:48 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" returned: 0 in 0.599s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:48 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a Sep 25 11:47:48 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:48 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a" returned: 0 in 0.411s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:48 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a Sep 25 11:47:48 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:48 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a.460b03e7-14e3-4c30-891e-7a6595e5927a" returned: 0 in 0.314s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Lock "cinder-quobyte-460b03e7-14e3-4c30-891e-7a6595e5927a" released by "_delete_snapshot" :: held 1.902s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=40,cinder:UPDATE=52,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=44,cinder:SELECT=42,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.686s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.291s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-545974714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f29119e-17bf-42a6-9fa6-e00a6e91b9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb92af2c5b8243d1adfcbeb74f048953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:42Z,use_quota=True,user_id='275efe58c729418d8affbde68c404304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Creating volume 9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:48 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06739d6-65a2-4648-bcd5-1e6ff42abdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29512df-ca68-493a-ade7-bc6b4d190ca7', 'volume_size': 2, 'source_volid': 'bc19c1e7-811c-440c-8bf8-38fd55c9c55a', 'source_volstatus': 'available'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:48 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 1073741824 Sep 25 11:47:48 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d1002a-625b-4c7a-8d60-4e0d27e580a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Volume volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 (a29512df-ca68-493a-ade7-bc6b4d190ca7): created successfully Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d1002a-625b-4c7a-8d60-4e0d27e580a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Flow 'volume_create_manager' (89802a4c-4ef7-4766-be8e-354913fbead0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:49 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-42a09534-6e83-4672-9b0a-4373a7599ea2 tempest-VolumesCloneTest-1258970184 None] Created volume successfully. Sep 25 11:47:49 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 1073741824" returned: 0 in 0.511s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:49 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 Sep 25 11:47:49 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:49 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" returned: 0 in 0.306s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-0b862a69-f1e0-4054-a38d-af7acc29f00f req-658d7520-c90d-430b-a6c0-76a40c64d87f tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.430s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-0b862a69-f1e0-4054-a38d-af7acc29f00f req-658d7520-c90d-430b-a6c0-76a40c64d87f tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b39ced1-191e-4cb8-bd42-5b94bb4a67c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8e7370-2970-4d09-aeda-b1d0cd83e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Volume volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 (9f29119e-17bf-42a6-9fa6-e00a6e91b9b8): created successfully Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8e7370-2970-4d09-aeda-b1d0cd83e993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Flow 'volume_create_manager' (e4968be2-de24-45f0-99ef-97b1787970e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Acquiring lock "cinder-a29512df-ca68-493a-ade7-bc6b4d190ca7-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Lock "cinder-a29512df-ca68-493a-ade7-bc6b4d190ca7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:49 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8df9bdb0-414c-4609-b317-46745353d5c3 tempest-SnapshotMetadataTestJSON-1565653480 None] Created volume successfully. Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-0b862a69-f1e0-4054-a38d-af7acc29f00f req-658d7520-c90d-430b-a6c0-76a40c64d87f tempest-TestServerVolumeAttachmentScenario-369849265 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7bf2699-dfb1-45e6-aa33-a30626b9a2e3', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:47:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Acquiring lock "cinder-quobyte-a29512df-ca68-493a-ade7-bc6b4d190ca7" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Lock "cinder-quobyte-a29512df-ca68-493a-ade7-bc6b4d190ca7" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5f2561-8d1c-476a-a06e-da4f86840376]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-0b862a69-f1e0-4054-a38d-af7acc29f00f req-658d7520-c90d-430b-a6c0-76a40c64d87f tempest-TestServerVolumeAttachmentScenario-369849265 None] attachment_update completed successfully. Sep 25 11:47:50 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 Sep 25 11:47:50 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Creating offline snapshot 666cd5b0-1445-4220-bfd8-0eb32626f819 of volume 9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d6757e-c299-4af6-bdd2-6ede7e27801a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:50 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 Sep 25 11:47:50 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:50 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7" returned: 0 in 0.557s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:50 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7 Sep 25 11:47:50 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:50 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:50 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" returned: 0 in 0.533s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a29512df-ca68-493a-ade7-bc6b4d190ca7" returned: 0 in 0.339s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:50 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 1G Sep 25 11:47:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Lock "cinder-quobyte-a29512df-ca68-493a-ade7-bc6b4d190ca7" released by "delete_volume" :: held 0.969s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:50 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Created reservations ['2109acd5-b574-4453-a749-636d8089958a', '7226e99d-ec74-4e2b-9e0d-06d80e388466', 'b207a5c0-095d-451a-9534-a651efe39102', '4e477955-7870-4739-b1f9-3f949a1178ba'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:51 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:47:51 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:51 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 1G" returned: 0 in 0.605s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:51 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 Sep 25 11:47:51 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:51 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.420s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:51 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Deleted volume successfully. Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-45ac9ba9-4a0f-4318-aa75-3704d392c0e9 tempest-VolumesCloneTest-1258970184 None] Lock "cinder-a29512df-ca68-493a-ade7-bc6b4d190ca7-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:51 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:51 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 is being set with open permissions: ugo+rw Sep 25 11:47:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:51 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 Sep 25 11:47:51 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:52 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819" returned: 0 in 0.302s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:52 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.info Sep 25 11:47:52 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Acquiring lock "cinder-bc19c1e7-811c-440c-8bf8-38fd55c9c55a-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Lock "cinder-bc19c1e7-811c-440c-8bf8-38fd55c9c55a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Acquiring lock "cinder-quobyte-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Lock "cinder-quobyte-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f6c18-4307-41da-8615-31b1e247abf3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:52 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.info" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:52 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.info is being set with open permissions: ugo+rw Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:52 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a Sep 25 11:47:52 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:52 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.info Sep 25 11:47:52 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:52 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" returned: 0 in 0.430s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:52 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a Sep 25 11:47:52 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:52 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.info" returned: 0 in 0.351s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-93f5fcef-bcab-4e0c-a15c-df98babbbc12 tempest-SnapshotMetadataTestJSON-1565653480 None] Create snapshot completed successfully Sep 25 11:47:53 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Lock "cinder-quobyte-bc19c1e7-811c-440c-8bf8-38fd55c9c55a" released by "delete_volume" :: held 0.872s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Created reservations ['f93aed71-fe82-4358-b5c0-d3879bfe7dde', 'ac176fd9-1ae3-4f64-a409-f676c70e3c27', '3d6c9e57-5ad7-4ef6-bbbb-83d517550146', 'aeb71850-66e7-4a14-93dd-41ad912bdb78'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:53 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:47:53 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:53 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.325s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Deleted volume successfully. Sep 25 11:47:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e4f886d1-a4c0-4691-a47e-939fd66f72cf tempest-VolumesCloneTest-1258970184 None] Lock "cinder-bc19c1e7-811c-440c-8bf8-38fd55c9c55a-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "cinder-666cd5b0-1445-4220-bfd8-0eb32626f819-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-666cd5b0-1445-4220-bfd8-0eb32626f819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "cinder-quobyte-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-quobyte-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "cinder-quobyte-666cd5b0-1445-4220-bfd8-0eb32626f819" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-quobyte-666cd5b0-1445-4220-bfd8-0eb32626f819" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Deleting offline snapshot 666cd5b0-1445-4220-bfd8-0eb32626f819 of volume 9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] snapshot_file for this snap is: volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc58a7a-879b-4374-b464-0e5a044ca407]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:54 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 Sep 25 11:47:54 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:55 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819" returned: 0 in 0.513s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:47:55 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4a1324-ebfb-4c28-a9e4-1533576c3681]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:55 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 Sep 25 11:47:55 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:56 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" returned: 0 in 0.631s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:56 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 Sep 25 11:47:56 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-a2ad91d3-1ba9-4bc9-9eb9-05995cc15856 req-87800efc-c18f-4a25-8971-13aec5a530c7 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-a2ad91d3-1ba9-4bc9-9eb9-05995cc15856 req-87800efc-c18f-4a25-8971-13aec5a530c7 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-a2ad91d3-1ba9-4bc9-9eb9-05995cc15856 req-87800efc-c18f-4a25-8971-13aec5a530c7 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-a2ad91d3-1ba9-4bc9-9eb9-05995cc15856 req-87800efc-c18f-4a25-8971-13aec5a530c7 tempest-TestServerVolumeAttachmentScenario-369849265 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d6a1e40-53a2-45c8-b392-cbe11b287cc4', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:47:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-a2ad91d3-1ba9-4bc9-9eb9-05995cc15856 req-87800efc-c18f-4a25-8971-13aec5a530c7 tempest-TestServerVolumeAttachmentScenario-369849265 None] attachment_update completed successfully. Sep 25 11:47:56 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819" returned: 0 in 0.593s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:56 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819 Sep 25 11:47:56 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:57 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8.666cd5b0-1445-4220-bfd8-0eb32626f819" returned: 0 in 0.493s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-quobyte-666cd5b0-1445-4220-bfd8-0eb32626f819" released by "_delete_snapshot" :: held 2.410s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-quobyte-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" released by "delete_snapshot" :: held 2.447s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:57 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Created reservations ['7d88104c-d565-4cd7-9fcb-4ddd7454dbfc', '65aedf3f-c6fb-4ca2-ae79-de37035e31b6', 'a34984c2-0746-4743-b873-e50ffd24a38f', '17c246c6-e07f-410d-b8f4-83a06f404adf'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Delete snapshot completed successfully. Sep 25 11:47:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b9787cec-a812-493b-9e9d-989c84e2dfb2 tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-666cd5b0-1445-4220-bfd8-0eb32626f819-delete_snapshot" released by "delete_snapshot" :: held 2.703s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "cinder-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "cinder-quobyte-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-quobyte-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:58 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dbabc4-f4b2-4aa0-bce7-b871968643d0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:58 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 Sep 25 11:47:58 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:58 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" returned: 0 in 0.541s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:58 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8 Sep 25 11:47:58 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:59 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" returned: 0 in 0.370s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-quobyte-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8" released by "delete_volume" :: held 1.023s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Created reservations ['14b48339-984b-45f7-8546-7725c1950c0c', 'f78441ba-7e5d-44d0-8145-e44660a7cc80', '89925504-f470-4f51-82ce-c520e54a18be', 'c9cfd5a0-ee89-4b7c-a354-ae11fdb224d1'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:59 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:47:59 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:59 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-6677c1e6-361b-4464-8b52-1301898d2c96 req-6de1558b-1c55-4bb4-b9cb-ce641a5177a9 tempest-TestServerVolumeAttachmentScenario-369849265 None] Terminate volume connection completed successfully. Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-6677c1e6-361b-4464-8b52-1301898d2c96 req-6de1558b-1c55-4bb4-b9cb-ce641a5177a9 tempest-TestServerVolumeAttachmentScenario-369849265 None] Deleting attachment 4d6a1e40-53a2-45c8-b392-cbe11b287cc4. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Flow 'volume_create_manager' (a4fd329b-c3c3-4e3d-9b4e-4c116173d621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35873f7b-4cff-465d-9f13-616c54e1fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35873f7b-4cff-465d-9f13-616c54e1fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-279393724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaea579-a976-47bb-be11-5616c1081314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c151425c4ec145fb9ee594ecd4cd7471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:00Z,use_quota=True,user_id='ee6d48fda4d74baf9c3bea42470989c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1083f18-07df-4ac9-a71e-082a0f10b389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1083f18-07df-4ac9-a71e-082a0f10b389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fab6616-ff24-4ff4-8a85-bb5b7bba6230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fab6616-ff24-4ff4-8a85-bb5b7bba6230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbaea579-a976-47bb-be11-5616c1081314', 'volume_name': 'volume-dbaea579-a976-47bb-be11-5616c1081314', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96634d94-04bf-4b24-8078-233dbde227cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96634d94-04bf-4b24-8078-233dbde227cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072a0eec-584e-4e43-8302-28994528b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:59 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Volume dbaea579-a976-47bb-be11-5616c1081314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbaea579-a976-47bb-be11-5616c1081314', 'volume_size': 1} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-279393724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaea579-a976-47bb-be11-5616c1081314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c151425c4ec145fb9ee594ecd4cd7471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:00Z,use_quota=True,user_id='ee6d48fda4d74baf9c3bea42470989c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Creating volume dbaea579-a976-47bb-be11-5616c1081314 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:59 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:59 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 1073741824 Sep 25 11:47:59 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:59 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.392s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:59 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Deleted volume successfully. Sep 25 11:47:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-38eb9b7d-7d94-4e7e-8908-e40d1df5ef6d tempest-SnapshotMetadataTestJSON-1565653480 None] Lock "cinder-9f29119e-17bf-42a6-9fa6-e00a6e91b9b8-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:00 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 1073741824" returned: 0 in 0.553s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:00 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 Sep 25 11:48:00 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:00 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314" returned: 0 in 0.312s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072a0eec-584e-4e43-8302-28994528b99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbaea579-a976-47bb-be11-5616c1081314', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58aded9d-6c7c-44be-8501-dbf8dc712566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Volume volume-dbaea579-a976-47bb-be11-5616c1081314 (dbaea579-a976-47bb-be11-5616c1081314): created successfully Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58aded9d-6c7c-44be-8501-dbf8dc712566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Flow 'volume_create_manager' (a4fd329b-c3c3-4e3d-9b4e-4c116173d621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-138a9369-cb02-4bc3-aab7-7fb879116017 tempest-VolumesNegativeTest-1813096167 None] Created volume successfully. Sep 25 11:48:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-654b5561-d3e5-4b7e-afec-f1a616e60066 req-0125ea97-0401-498a-9d94-04f01c5717d4 tempest-TestServerVolumeAttachmentScenario-369849265 None] Terminate volume connection completed successfully. Sep 25 11:48:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-654b5561-d3e5-4b7e-afec-f1a616e60066 req-0125ea97-0401-498a-9d94-04f01c5717d4 tempest-TestServerVolumeAttachmentScenario-369849265 None] Deleting attachment c7bf2699-dfb1-45e6-aa33-a30626b9a2e3. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Flow 'volume_create_manager' (cf2d5152-5090-4826-8b00-d8ed4722f423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09b42e7-4a83-4dd8-adde-c93da7db23a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09b42e7-4a83-4dd8-adde-c93da7db23a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-564148360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f26628-6ab9-4549-a3eb-bee1dcf10ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d9ddeba5248ccab903fdbe1c4ccad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:07Z,use_quota=True,user_id='172e984518364e6db35c042fef27ddae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a04a28-6272-453e-a2ca-e06628c933dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a04a28-6272-453e-a2ca-e06628c933dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd41b35-a5e1-4625-b878-5b20c739cf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd41b35-a5e1-4625-b878-5b20c739cf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f26628-6ab9-4549-a3eb-bee1dcf10ada', 'volume_name': 'volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada', 'volume_size': 2}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d75d9f1-aaf7-4b9a-bb99-f222cf905936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d75d9f1-aaf7-4b9a-bb99-f222cf905936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b001b564-1c86-4343-a977-3bc6b3c6204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Volume e1f26628-6ab9-4549-a3eb-bee1dcf10ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada', 'volume_size': 2} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-564148360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f26628-6ab9-4549-a3eb-bee1dcf10ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d9ddeba5248ccab903fdbe1c4ccad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:07Z,use_quota=True,user_id='172e984518364e6db35c042fef27ddae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Creating volume e1f26628-6ab9-4549-a3eb-bee1dcf10ada {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:06 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:48:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada 2147483648 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:06 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada 2147483648 Sep 25 11:48:06 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:07 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada 2147483648" returned: 0 in 0.813s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:07 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada Sep 25 11:48:07 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "cinder-1af5a569-a67c-4ab8-9f6f-b227c8da24a2-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "cinder-1af5a569-a67c-4ab8-9f6f-b227c8da24a2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "cinder-quobyte-1af5a569-a67c-4ab8-9f6f-b227c8da24a2" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "cinder-quobyte-1af5a569-a67c-4ab8-9f6f-b227c8da24a2" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:08 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada" returned: 0 in 0.467s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b001b564-1c86-4343-a977-3bc6b3c6204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada', 'volume_size': 2}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac5969f-bc33-401d-a9ef-141856667613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b346c3a-9184-480c-a5a6-28d7b4468213]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:08 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Volume volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada (e1f26628-6ab9-4549-a3eb-bee1dcf10ada): created successfully Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac5969f-bc33-401d-a9ef-141856667613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Flow 'volume_create_manager' (cf2d5152-5090-4826-8b00-d8ed4722f423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:08 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a7e3c01c-a361-4528-ba02-1a8be2ab8887 tempest-VolumesCloneNegativeTest-1439025051 None] Created volume successfully. Sep 25 11:48:08 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 Sep 25 11:48:08 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:08 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2" returned: 0 in 0.646s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:08 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2 Sep 25 11:48:08 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Acquiring lock "cinder-e1f26628-6ab9-4549-a3eb-bee1dcf10ada-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "cinder-e1f26628-6ab9-4549-a3eb-bee1dcf10ada-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Acquiring lock "cinder-quobyte-e1f26628-6ab9-4549-a3eb-bee1dcf10ada" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "cinder-quobyte-e1f26628-6ab9-4549-a3eb-bee1dcf10ada" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef24b19-0feb-4be6-afb0-53b83355f9e0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:09 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1af5a569-a67c-4ab8-9f6f-b227c8da24a2" returned: 0 in 0.437s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "cinder-quobyte-1af5a569-a67c-4ab8-9f6f-b227c8da24a2" released by "delete_volume" :: held 1.200s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:09 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Created reservations ['47beea32-a0bc-4219-83be-f6b9c170c4ab', '41cb6d8c-9261-4e88-aab6-04d1a717744f', '3aadd33a-470b-4cdd-bb06-404083e40c80', 'd097ac03-2b89-422b-b241-2e153ba17a84'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:09 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:09 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:09 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:09 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada" returned: 0 in 0.557s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:09 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada Sep 25 11:48:09 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:09 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.363s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:09 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Deleted volume successfully. Sep 25 11:48:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-abd7377b-91d8-434d-9c21-0be73fc32052 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "cinder-1af5a569-a67c-4ab8-9f6f-b227c8da24a2-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:10 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e1f26628-6ab9-4549-a3eb-bee1dcf10ada" returned: 0 in 0.318s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "cinder-quobyte-e1f26628-6ab9-4549-a3eb-bee1dcf10ada" released by "delete_volume" :: held 0.949s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Created reservations ['65dd32ce-3fa0-432e-b465-41ebfe5e7243', '9d63932e-3fde-4b2c-bae8-3a651f0e73fc', '4a7cef1d-b86f-461c-a790-203fef187fe3', 'e5fe01bb-ee58-4cde-9159-d628287d73cf'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "cinder-deb0d376-2fa6-425e-8b92-9e10bee5fd32-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:10 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "cinder-deb0d376-2fa6-425e-8b92-9e10bee5fd32-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:10 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "cinder-quobyte-deb0d376-2fa6-425e-8b92-9e10bee5fd32" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "cinder-quobyte-deb0d376-2fa6-425e-8b92-9e10bee5fd32" acquired by "delete_volume" :: waited 0.066s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd7e95-a280-4aa0-9438-e009df130129]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:10 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.637s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:11 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Deleted volume successfully. Sep 25 11:48:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9cf091e3-23d9-4720-8c68-7b1410079950 tempest-VolumesCloneNegativeTest-1439025051 None] Lock "cinder-e1f26628-6ab9-4549-a3eb-bee1dcf10ada-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:11 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 Sep 25 11:48:11 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:11 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32" returned: 0 in 0.877s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:11 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32 Sep 25 11:48:11 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:12 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-deb0d376-2fa6-425e-8b92-9e10bee5fd32" returned: 0 in 0.631s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "cinder-quobyte-deb0d376-2fa6-425e-8b92-9e10bee5fd32" released by "delete_volume" :: held 1.643s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Created reservations ['08e86dff-c6d8-41fd-ba19-42baa811e43b', 'f92fb383-0a12-4ede-b032-805976c77434', 'e63b3b55-7c8d-4f8c-900e-55e20bb39040', 'bcb8d104-fd2e-4771-b6b1-f9b18ac91bef'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:12 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:12 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:13 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.499s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:13 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Deleted volume successfully. Sep 25 11:48:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ecdfcccb-0b7e-4589-a5fb-68f39ea1fb74 tempest-TestServerVolumeAttachmentScenario-369849265 None] Lock "cinder-deb0d376-2fa6-425e-8b92-9e10bee5fd32-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (28890f30-d0da-4ec8-a23e-9dc643bce2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783d4849-866e-469b-86ee-45a80c94992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783d4849-866e-469b-86ee-45a80c94992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1222890477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e3f165-2078-44e9-a328-1c966f4b7335,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:18Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3edbf2d-0b96-40f3-b52c-8de177bbfae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3edbf2d-0b96-40f3-b52c-8de177bbfae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a17026-8eaf-46ea-bda6-07e504452c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a17026-8eaf-46ea-bda6-07e504452c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e3f165-2078-44e9-a328-1c966f4b7335', 'volume_name': 'volume-72e3f165-2078-44e9-a328-1c966f4b7335', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa88efc-3283-4f44-b21b-c7bd900b9f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa88efc-3283-4f44-b21b-c7bd900b9f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1cd56b-8aa7-4c47-9671-29d856369583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:18 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Volume 72e3f165-2078-44e9-a328-1c966f4b7335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e3f165-2078-44e9-a328-1c966f4b7335', 'volume_size': 1} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1222890477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e3f165-2078-44e9-a328-1c966f4b7335,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:18Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Creating volume 72e3f165-2078-44e9-a328-1c966f4b7335 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:18 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:48:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:18 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 1073741824 Sep 25 11:48:18 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:19 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 1073741824" returned: 0 in 0.825s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:19 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 Sep 25 11:48:19 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:19 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335" returned: 0 in 0.388s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1cd56b-8aa7-4c47-9671-29d856369583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e3f165-2078-44e9-a328-1c966f4b7335', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad4daa5-328d-456e-90b1-6f04246831c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Volume volume-72e3f165-2078-44e9-a328-1c966f4b7335 (72e3f165-2078-44e9-a328-1c966f4b7335): created successfully Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad4daa5-328d-456e-90b1-6f04246831c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (28890f30-d0da-4ec8-a23e-9dc643bce2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:19 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3791d416-c6da-48d9-acbc-8975332e7742 tempest-VolumesGetTest-593811276 None] Created volume successfully. Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (c853b3ef-4929-458c-91b3-035fcaba664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99398c0c-4ceb-4c14-92f4-da535cf4a0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99398c0c-4ceb-4c14-92f4-da535cf4a0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1159098373',display_name='tempest-VolumesGetTest-Volume-1522470650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfcdd27b-9bad-42cd-bea3-07471456868a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:21Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d47cc5-a6fc-4eab-bde6-887acd7d412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d47cc5-a6fc-4eab-bde6-887acd7d412e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4e44da-0941-4ba0-8a82-30e46598ab09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4e44da-0941-4ba0-8a82-30e46598ab09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfcdd27b-9bad-42cd-bea3-07471456868a', 'volume_name': 'volume-bfcdd27b-9bad-42cd-bea3-07471456868a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc47d70-810c-436b-87a9-5203c93c4686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc47d70-810c-436b-87a9-5203c93c4686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b32500c-6f06-43fd-ad3a-db33f04d08c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:21 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Volume bfcdd27b-9bad-42cd-bea3-07471456868a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfcdd27b-9bad-42cd-bea3-07471456868a', 'volume_size': 1} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1159098373',display_name='tempest-VolumesGetTest-Volume-1522470650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfcdd27b-9bad-42cd-bea3-07471456868a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:21Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Creating volume bfcdd27b-9bad-42cd-bea3-07471456868a {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:21 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:48:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:21 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a 1073741824 Sep 25 11:48:21 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:22 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a 1073741824" returned: 0 in 0.571s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:22 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a Sep 25 11:48:22 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:22 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a" returned: 0 in 0.422s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b32500c-6f06-43fd-ad3a-db33f04d08c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfcdd27b-9bad-42cd-bea3-07471456868a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7e5b2f-06f3-4a7c-a0e2-1b5e4f342e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:22 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Volume volume-bfcdd27b-9bad-42cd-bea3-07471456868a (bfcdd27b-9bad-42cd-bea3-07471456868a): created successfully Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7e5b2f-06f3-4a7c-a0e2-1b5e4f342e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (c853b3ef-4929-458c-91b3-035fcaba664a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-bbcdc7a1-e867-4be9-a84a-1f011a1294ba tempest-VolumesGetTest-593811276 None] Created volume successfully. Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:23 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:23 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:23 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.405s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-bfcdd27b-9bad-42cd-bea3-07471456868a-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Lock "cinder-bfcdd27b-9bad-42cd-bea3-07471456868a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-bfcdd27b-9bad-42cd-bea3-07471456868a" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-bfcdd27b-9bad-42cd-bea3-07471456868a" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:24 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4fae51-8466-401d-9d22-e83aef3033ac]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:24 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a Sep 25 11:48:24 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:24 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a" returned: 0 in 0.535s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:24 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a Sep 25 11:48:24 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:24 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bfcdd27b-9bad-42cd-bea3-07471456868a" returned: 0 in 0.331s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-bfcdd27b-9bad-42cd-bea3-07471456868a" released by "delete_volume" :: held 0.945s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:24 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Created reservations ['566a8754-4439-460f-89bb-cc46ec97869c', '7a33ede4-ac2c-4620-821f-4094e53ead54', 'b7d1a967-a114-4f1e-b0a9-882d3b3e3e41', '256ce2e7-e48d-402d-9117-3d151cad8e7c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:25 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:25 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-72e3f165-2078-44e9-a328-1c966f4b7335-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Lock "cinder-72e3f165-2078-44e9-a328-1c966f4b7335-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-72e3f165-2078-44e9-a328-1c966f4b7335" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-72e3f165-2078-44e9-a328-1c966f4b7335" acquired by "delete_volume" :: waited 0.041s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59dbf3c-02d9-491a-899c-5e73fd2eddcf]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:25 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.512s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Deleted volume successfully. Sep 25 11:48:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ac310c-f4d6-4909-8efb-d486bd8ba3f8 tempest-VolumesGetTest-593811276 None] Lock "cinder-bfcdd27b-9bad-42cd-bea3-07471456868a-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:25 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 Sep 25 11:48:25 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:26 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335" returned: 0 in 0.629s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:26 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335 Sep 25 11:48:26 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:26 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-72e3f165-2078-44e9-a328-1c966f4b7335" returned: 0 in 0.357s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-72e3f165-2078-44e9-a328-1c966f4b7335" released by "delete_volume" :: held 1.127s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Created reservations ['822d79e7-a1ff-4ef7-ae7f-b2b9104b5a1f', '7410ba19-4508-4700-8aec-0cdbb7f8b2c8', '60b952b9-a248-4099-8e57-d59a9e19b8fd', '60337faa-b6ee-4714-955c-0a23a48c824b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:26 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:26 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:27 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.308s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:27 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:27 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Deleted volume successfully. Sep 25 11:48:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4b277a7b-24e3-4d8f-b3e5-db95fa76db83 tempest-VolumesGetTest-593811276 None] Lock "cinder-72e3f165-2078-44e9-a328-1c966f4b7335-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (ea915a96-f47d-4f18-8be6-419c5ea3e43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ed180-7652-4590-8416-a251b42b84b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ed180-7652-4590-8416-a251b42b84b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-770338699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b65d044-1085-46a1-9546-f2ced53a24a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:28Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627348e8-f56c-4759-97cc-5612d9a21e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627348e8-f56c-4759-97cc-5612d9a21e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96c1289-ddb7-475e-9215-87bbc7f8ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96c1289-ddb7-475e-9215-87bbc7f8ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b65d044-1085-46a1-9546-f2ced53a24a7', 'volume_name': 'volume-2b65d044-1085-46a1-9546-f2ced53a24a7', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98044e0e-5659-48e8-bf80-0a27148e3d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98044e0e-5659-48e8-bf80-0a27148e3d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31a61c6-20bc-4984-9aa8-89fcf3865d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Volume 2b65d044-1085-46a1-9546-f2ced53a24a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b65d044-1085-46a1-9546-f2ced53a24a7', 'volume_size': 1} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-770338699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b65d044-1085-46a1-9546-f2ced53a24a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:28Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Creating volume 2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:28 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:48:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:28 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 1073741824 Sep 25 11:48:28 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:29 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 1073741824" returned: 0 in 0.736s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:29 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 Sep 25 11:48:29 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:29 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31a61c6-20bc-4984-9aa8-89fcf3865d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b65d044-1085-46a1-9546-f2ced53a24a7', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26aaa96-b50e-45fa-ace9-60b5bb2b162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:29 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Volume volume-2b65d044-1085-46a1-9546-f2ced53a24a7 (2b65d044-1085-46a1-9546-f2ced53a24a7): created successfully Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26aaa96-b50e-45fa-ace9-60b5bb2b162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (ea915a96-f47d-4f18-8be6-419c5ea3e43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-59aa4bf1-7565-4859-81cd-d1ada868cb7a tempest-VolumesGetTest-593811276 None] Created volume successfully. Sep 25 11:48:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Acquiring lock "cinder-dbaea579-a976-47bb-be11-5616c1081314-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Lock "cinder-dbaea579-a976-47bb-be11-5616c1081314-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Acquiring lock "cinder-quobyte-dbaea579-a976-47bb-be11-5616c1081314" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Lock "cinder-quobyte-dbaea579-a976-47bb-be11-5616c1081314" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:30 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a65543-8933-4c66-97a0-a5b3bd2f02c6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:30 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 Sep 25 11:48:30 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:31 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314" returned: 0 in 0.546s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:31 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314 Sep 25 11:48:31 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (27d97209-7ac7-4894-b78d-b9a70b5a22e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf930c3a-e7b0-4fd7-9570-abe819b9bc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf930c3a-e7b0-4fd7-9570-abe819b9bc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-89718017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67aba31f-44ac-416c-836a-9d1a235ee4d4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2b65d044-1085-46a1-9546-f2ced53a24a7,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:31Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef25a4e-9cec-4f6a-afcd-bfc769f03ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:31 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef25a4e-9cec-4f6a-afcd-bfc769f03ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da087cc-b73c-4128-9ec2-440dba466ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dbaea579-a976-47bb-be11-5616c1081314" returned: 0 in 0.495s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da087cc-b73c-4128-9ec2-440dba466ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '67aba31f-44ac-416c-836a-9d1a235ee4d4', 'volume_name': 'volume-67aba31f-44ac-416c-836a-9d1a235ee4d4', 'volume_size': 1, 'source_volid': '2b65d044-1085-46a1-9546-f2ced53a24a7', 'source_volstatus': 'available'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e859bcd1-71f4-4964-acda-d6b3c86098ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e859bcd1-71f4-4964-acda-d6b3c86098ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557f2b0a-2669-4e42-b27b-1305bde85b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Volume 67aba31f-44ac-416c-836a-9d1a235ee4d4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-67aba31f-44ac-416c-836a-9d1a235ee4d4', 'volume_size': 1, 'source_volid': '2b65d044-1085-46a1-9546-f2ced53a24a7', 'source_volstatus': 'available'} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Lock "cinder-quobyte-dbaea579-a976-47bb-be11-5616c1081314" released by "delete_volume" :: held 1.132s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:31 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Cloning volume 2b65d044-1085-46a1-9546-f2ced53a24a7 to volume 67aba31f-44ac-416c-836a-9d1a235ee4d4 Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Creating offline snapshot e310ca4f-4300-4350-8909-0a00cce8590f of volume 2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3826e75e-1f5e-4903-9edd-f4bfa4d816b1]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Created reservations ['9704c5ca-773d-476a-8fa9-8cc860d25fd7', '09cd3ecf-5495-4caf-b4f6-4b92a29ad370', '4a887f62-d57f-4b2e-ba7a-b04ea3262835', '8d9da01c-eb78-4e6e-89f0-d4b983f2b76b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:31 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 Sep 25 11:48:31 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:31 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:31 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:32 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.373s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:32 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:32 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Deleted volume successfully. Sep 25 11:48:32 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-697e18b5-3d93-455c-8556-1e1f309bbd17 tempest-VolumesNegativeTest-1813096167 None] Lock "cinder-dbaea579-a976-47bb-be11-5616c1081314-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7" returned: 0 in 0.582s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:32 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f 1G Sep 25 11:48:32 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:33 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f 1G" returned: 0 in 0.730s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b65d044-1085-46a1-9546-f2ced53a24a7 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:33 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b65d044-1085-46a1-9546-f2ced53a24a7 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f Sep 25 11:48:33 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:33 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b65d044-1085-46a1-9546-f2ced53a24a7 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f" returned: 0 in 0.401s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:33 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f is being set with open permissions: ugo+rw Sep 25 11:48:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:33 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f Sep 25 11:48:33 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:33 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f" returned: 0 in 0.328s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:33 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.info Sep 25 11:48:33 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:34 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.info" returned: 0 in 0.327s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:34 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.info is being set with open permissions: ugo+rw Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:34 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.info Sep 25 11:48:34 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:34 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.info" returned: 0 in 0.355s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-67aba31f-44ac-416c-836a-9d1a235ee4d4" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-67aba31f-44ac-416c-836a-9d1a235ee4d4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] snapshot: e310ca4f-4300-4350-8909-0a00cce8590f, volume: 67aba31f-44ac-416c-836a-9d1a235ee4d4, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90da692-1aef-478a-beb1-0626ad3fa761]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:34 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f Sep 25 11:48:34 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:35 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f" returned: 0 in 0.527s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b65d044-1085-46a1-9546-f2ced53a24a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3994c130-fd66-413e-8eef-109fb8291d8c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:35 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 Sep 25 11:48:35 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:35 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7" returned: 0 in 0.553s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:48:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:35 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 Sep 25 11:48:35 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Flow 'volume_create_manager' (71b62aa3-1f3d-47d0-8969-24ff62b80be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a94720-b9fd-4001-b8a7-57c29ceda717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a94720-b9fd-4001-b8a7-57c29ceda717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-639936378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad979375-7c05-47e6-8760-38033e21e478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20bfb33b144d4207a0f336b4057a8591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:38Z,use_quota=True,user_id='7ca7b386dc574b89824dd02dc8f16d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99fd731-8b46-4442-9214-47dd22ae7503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99fd731-8b46-4442-9214-47dd22ae7503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060f1d47-e708-4164-8852-15361ee9c920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060f1d47-e708-4164-8852-15361ee9c920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad979375-7c05-47e6-8760-38033e21e478', 'volume_name': 'volume-ad979375-7c05-47e6-8760-38033e21e478', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ccfa21-fa43-4334-ad84-386969ec9353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ccfa21-fa43-4334-ad84-386969ec9353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943ddbbb-0891-49e3-b70b-1849c35e15fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:38 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Volume ad979375-7c05-47e6-8760-38033e21e478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad979375-7c05-47e6-8760-38033e21e478', 'volume_size': 1} Sep 25 11:48:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:45 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4" returned: 0 in 9.458s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:48:45 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Converted 1024.00 MB image at 108.25 MB/s Sep 25 11:48:45 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 is being set with open permissions: ugo+rw Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:45 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 Sep 25 11:48:45 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:45 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4" returned: 0 in 0.405s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-67aba31f-44ac-416c-836a-9d1a235ee4d4" released by "_copy_volume_from_snapshot" :: held 11.068s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-e310ca4f-4300-4350-8909-0a00cce8590f" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-e310ca4f-4300-4350-8909-0a00cce8590f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Deleting offline snapshot e310ca4f-4300-4350-8909-0a00cce8590f of volume 2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] snapshot_file for this snap is: volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bd1b16-c9d7-4cba-abe6-72bde79d41f3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:45 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f Sep 25 11:48:45 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:46 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f" returned: 0 in 0.612s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b65d044-1085-46a1-9546-f2ced53a24a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:48:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf13a99c-3d32-4388-b836-011d875f2e55]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:46 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 Sep 25 11:48:46 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:46 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7" returned: 0 in 0.617s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:47 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f Sep 25 11:48:47 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:47 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f" returned: 0 in 0.495s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:47 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f Sep 25 11:48:47 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:47 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7.e310ca4f-4300-4350-8909-0a00cce8590f" returned: 0 in 0.337s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-e310ca4f-4300-4350-8909-0a00cce8590f" released by "_delete_snapshot" :: held 2.238s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.348s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.127s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-639936378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad979375-7c05-47e6-8760-38033e21e478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20bfb33b144d4207a0f336b4057a8591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:38Z,use_quota=True,user_id='7ca7b386dc574b89824dd02dc8f16d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Creating volume ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:47 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:48:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:48 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 1073741824 Sep 25 11:48:48 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557f2b0a-2669-4e42-b27b-1305bde85b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67aba31f-44ac-416c-836a-9d1a235ee4d4', 'volume_size': 1, 'source_volid': '2b65d044-1085-46a1-9546-f2ced53a24a7', 'source_volstatus': 'available'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e81f476-67f4-4f66-a97b-5cad40c40db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:48 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Volume volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 (67aba31f-44ac-416c-836a-9d1a235ee4d4): created successfully Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e81f476-67f4-4f66-a97b-5cad40c40db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (27d97209-7ac7-4894-b78d-b9a70b5a22e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:48 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6608cf30-6eaf-4c1c-b299-d64a7bb77a98 tempest-VolumesGetTest-593811276 None] Created volume successfully. Sep 25 11:48:48 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 1073741824" returned: 0 in 0.616s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:48 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 Sep 25 11:48:48 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:48 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478" returned: 0 in 0.330s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=89,cinder:UPDATE=91,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:48:48 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943ddbbb-0891-49e3-b70b-1849c35e15fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad979375-7c05-47e6-8760-38033e21e478', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c3482c-1d5f-4011-912d-5e16b17fb377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=126,cinder:DELETE=8,cinder:SELECT=85,cinder:INSERT=22 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:48:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Volume volume-ad979375-7c05-47e6-8760-38033e21e478 (ad979375-7c05-47e6-8760-38033e21e478): created successfully Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c3482c-1d5f-4011-912d-5e16b17fb377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Flow 'volume_create_manager' (71b62aa3-1f3d-47d0-8969-24ff62b80be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:49 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5e64117f-3c6f-4b40-991c-aa97aa6c19fc tempest-VolumesSnapshotListTestJSON-1153147604 None] Created volume successfully. Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (20908c0e-6ee4-40a9-be5d-4c5ee7cc7d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f36d8e-c42f-4858-bfd9-3287e72e2a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f36d8e-c42f-4858-bfd9-3287e72e2a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-967916514',display_name='tempest-VolumesGetTest-Volume-1021373481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c0e0f7-7a03-4290-9772-0a6a4720be7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:49Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049bbbce-4128-4b02-9f65-c9188a8ac7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049bbbce-4128-4b02-9f65-c9188a8ac7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ca5f09-3ccf-412b-93aa-c3dfc61c72a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ca5f09-3ccf-412b-93aa-c3dfc61c72a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c0e0f7-7a03-4290-9772-0a6a4720be7c', 'volume_name': 'volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c39fd15-feda-4232-8dce-beeb738adb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c39fd15-feda-4232-8dce-beeb738adb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36396c6f-ec11-4195-89a3-63e16097eb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Volume f9c0e0f7-7a03-4290-9772-0a6a4720be7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c', 'volume_size': 1} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-967916514',display_name='tempest-VolumesGetTest-Volume-1021373481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c0e0f7-7a03-4290-9772-0a6a4720be7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:49Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Creating volume f9c0e0f7-7a03-4290-9772-0a6a4720be7c {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:49 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:49 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c 1073741824 Sep 25 11:48:49 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:50 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c 1073741824" returned: 0 in 0.609s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:50 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c Sep 25 11:48:50 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:50 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c" returned: 0 in 0.275s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.637s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36396c6f-ec11-4195-89a3-63e16097eb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133e0b18-4cd7-4105-a1a5-2cd67f565954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Creating offline snapshot 17b1e514-7477-4b04-a74b-d273dea0a6f5 of volume ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:48:50 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Volume volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c (f9c0e0f7-7a03-4290-9772-0a6a4720be7c): created successfully Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133e0b18-4cd7-4105-a1a5-2cd67f565954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (20908c0e-6ee4-40a9-be5d-4c5ee7cc7d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7198f494-525d-44a6-bb65-85f21fadb22c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ded4f34b-763d-4cc4-b15e-caae098c7067 tempest-VolumesGetTest-593811276 None] Created volume successfully. Sep 25 11:48:50 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 Sep 25 11:48:50 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:51 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478" returned: 0 in 0.455s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:51 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 1G Sep 25 11:48:51 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:51 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 1G" returned: 0 in 0.553s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:51 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 Sep 25 11:48:51 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-f9c0e0f7-7a03-4290-9772-0a6a4720be7c-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Lock "cinder-f9c0e0f7-7a03-4290-9772-0a6a4720be7c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-f9c0e0f7-7a03-4290-9772-0a6a4720be7c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-f9c0e0f7-7a03-4290-9772-0a6a4720be7c" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8d575c-4d52-4f34-8048-177cde5ba7d9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:52 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c Sep 25 11:48:52 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:52 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5" returned: 0 in 0.454s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:52 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 is being set with open permissions: ugo+rw Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:52 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 Sep 25 11:48:52 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:52 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5" returned: 0 in 0.318s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:52 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c" returned: 0 in 0.509s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:52 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c Sep 25 11:48:52 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:52 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.info Sep 25 11:48:52 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:52 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f9c0e0f7-7a03-4290-9772-0a6a4720be7c" returned: 0 in 0.348s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-f9c0e0f7-7a03-4290-9772-0a6a4720be7c" released by "delete_volume" :: held 0.936s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Created reservations ['61857e19-417b-43e9-834e-ed117cddf196', '694d3f05-1f62-4dbb-850a-224ffca3768a', '93d9e426-a915-40b6-b55b-4cc1eb80a192', '3e0db5b5-ac56-4c4b-a29b-c0ebc83afc6c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:52 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.info" returned: 0 in 0.420s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:52 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.info is being set with open permissions: ugo+rw Sep 25 11:48:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:53 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.info Sep 25 11:48:53 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:53 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:53 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:53 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.305s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:53 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Deleted volume successfully. Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.info" returned: 0 in 0.447s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f7346ded-c708-4794-bacb-7a2edcaff7c7 tempest-VolumesGetTest-593811276 None] Lock "cinder-f9c0e0f7-7a03-4290-9772-0a6a4720be7c-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f7402a62-1585-4a47-8a7f-2a8aa69874e8 tempest-VolumesSnapshotListTestJSON-1153147604 None] Create snapshot completed successfully Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-67aba31f-44ac-416c-836a-9d1a235ee4d4-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Lock "cinder-67aba31f-44ac-416c-836a-9d1a235ee4d4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-67aba31f-44ac-416c-836a-9d1a235ee4d4" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-67aba31f-44ac-416c-836a-9d1a235ee4d4" acquired by "delete_volume" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[975cafdc-6e1c-4ab1-a4c8-22c03950a0cd]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Creating offline snapshot 2c3d6422-5e89-4b54-9189-6a39d7e8dfba of volume ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a804524d-c770-4ba6-8a5f-3809a3d5d8c1]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:54 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 Sep 25 11:48:54 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:54 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 Sep 25 11:48:54 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:55 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4" returned: 0 in 0.630s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:55 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4 Sep 25 11:48:55 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:55 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5" returned: 0 in 0.559s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad979375-7c05-47e6-8760-38033e21e478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:55 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba 1G Sep 25 11:48:55 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:55 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-67aba31f-44ac-416c-836a-9d1a235ee4d4" returned: 0 in 0.396s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-67aba31f-44ac-416c-836a-9d1a235ee4d4" released by "delete_volume" :: held 1.124s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Created reservations ['a6b5f6d6-ddd5-4710-89b6-4e1e134b1e0b', 'aaf3e2db-bbc4-48e7-9449-c829966fad1e', '96f307c9-cf89-4f43-b778-6c35fe4aaed4', '59904af6-d032-4797-a195-cc463d3e3c5e'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:55 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:55 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:56 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba 1G" returned: 0 in 0.705s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:56 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba Sep 25 11:48:56 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:56 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.294s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Deleted volume successfully. Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0b4291c7-48fd-4225-9b8e-b71eafff894d tempest-VolumesGetTest-593811276 None] Lock "cinder-67aba31f-44ac-416c-836a-9d1a235ee4d4-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:56 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba" returned: 0 in 0.407s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:56 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba is being set with open permissions: ugo+rw Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:56 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba Sep 25 11:48:56 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:56 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-2b65d044-1085-46a1-9546-f2ced53a24a7-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba" returned: 0 in 0.391s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Lock "cinder-2b65d044-1085-46a1-9546-f2ced53a24a7-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0f149a01-9959-48a0-b7ad-cd298ea70ea3 tempest-VolumesSnapshotListTestJSON-1153147604 None] Create snapshot completed successfully Sep 25 11:48:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-2b65d044-1085-46a1-9546-f2ced53a24a7" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-2b65d044-1085-46a1-9546-f2ced53a24a7" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:57 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f28f4-b9b6-4751-a128-cdb1435d0afc]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:57 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 Sep 25 11:48:57 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:57 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7" returned: 0 in 0.492s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:57 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7 Sep 25 11:48:57 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:57 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b65d044-1085-46a1-9546-f2ced53a24a7" returned: 0 in 0.352s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-2b65d044-1085-46a1-9546-f2ced53a24a7" released by "delete_volume" :: held 0.946s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Created reservations ['73bdc969-4758-4a2a-8719-5feea49d6cd5', 'f8e6eb28-9241-41c6-94c3-3332480582c0', 'dc27ccff-1a48-4513-8929-aede147cbba2', '30a68bc8-42cc-41cc-b5b7-d6baeabc5931'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Creating offline snapshot 22e598e5-0674-4c12-81f0-4ad570bd2501 of volume ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1badd2-d8a9-40f7-abd1-8863c3b96b33]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:58 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:48:58 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:58 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba Sep 25 11:48:58 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:58 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.366s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Deleted volume successfully. Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c74315a-d7e3-4f16-a7ae-b12cadc2e6fa tempest-VolumesGetTest-593811276 None] Lock "cinder-2b65d044-1085-46a1-9546-f2ced53a24a7-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:58 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba" returned: 0 in 0.532s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad979375-7c05-47e6-8760-38033e21e478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:48:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:58 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 1G Sep 25 11:48:58 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:59 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 1G" returned: 0 in 0.758s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:59 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 Sep 25 11:48:59 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:00 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501" returned: 0 in 0.475s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:00 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 is being set with open permissions: ugo+rw Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:00 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 Sep 25 11:49:00 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (1f9dfc0b-73a2-40ed-a1e8-ca5db53af246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e7a02b-b738-41bf-bbc4-5ff94726794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:00 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501" returned: 0 in 0.328s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e7a02b-b738-41bf-bbc4-5ff94726794c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1578565978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe52cf27-a514-4290-bc55-99050065193a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:00Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fc7770-5b24-427e-be74-5ceacc5a7487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fc7770-5b24-427e-be74-5ceacc5a7487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e948c8db-1e90-4ea8-843f-03bbdb23dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:49:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-587cdfac-9db3-4ca9-9576-f5db2927a448 tempest-VolumesSnapshotListTestJSON-1153147604 None] Create snapshot completed successfully Sep 25 11:49:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e948c8db-1e90-4ea8-843f-03bbdb23dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe52cf27-a514-4290-bc55-99050065193a', 'volume_name': 'volume-fe52cf27-a514-4290-bc55-99050065193a', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7ed990-350a-4f48-9e5c-677bd73f8220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7ed990-350a-4f48-9e5c-677bd73f8220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9a2852-ba96-49a3-9df0-36a1984e97ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Volume fe52cf27-a514-4290-bc55-99050065193a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe52cf27-a514-4290-bc55-99050065193a', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:49:01 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Trying to clone fe52cf27-a514-4290-bc55-99050065193a from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:49:01 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:49:01 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:49:01 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3f630d-2f97-4cb7-94ca-05f3ccda0b34]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:01 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD Sep 25 11:49:01 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:02 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 is fetched for user 0d3781e2f2da46859769c1386d53a1dc. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[271418cc-59cc-4bc6-b15e-7c73f34c6cd8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:02 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD Sep 25 11:49:02 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:02 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1578565978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe52cf27-a514-4290-bc55-99050065193a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:00Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Creating volume fe52cf27-a514-4290-bc55-99050065193a {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:02 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:02 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a 1073741824 Sep 25 11:49:02 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-22e598e5-0674-4c12-81f0-4ad570bd2501-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-22e598e5-0674-4c12-81f0-4ad570bd2501-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-quobyte-22e598e5-0674-4c12-81f0-4ad570bd2501" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-22e598e5-0674-4c12-81f0-4ad570bd2501" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Deleting offline snapshot 22e598e5-0674-4c12-81f0-4ad570bd2501 of volume ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] snapshot_file for this snap is: volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[65808ed7-8c77-488c-b5b3-f7028ff329db]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:03 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 Sep 25 11:49:03 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:03 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a 1073741824" returned: 0 in 0.657s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:03 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501" returned: 0 in 0.514s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad979375-7c05-47e6-8760-38033e21e478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:03 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a Sep 25 11:49:03 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3403751b-2ec9-4e3f-b1c6-de055b3c7dd8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:03 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba Sep 25 11:49:03 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:03 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a" returned: 0 in 0.361s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Attempting download of 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume fe52cf27-a514-4290-bc55-99050065193a. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[05839286-d835-4660-938c-1460bb5016fe]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_ruv2pp9d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:04 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba" returned: 0 in 0.528s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad979375-7c05-47e6-8760-38033e21e478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:04 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 Sep 25 11:49:04 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:04 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_ruv2pp9d Sep 25 11:49:04 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:04 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_ruv2pp9d" returned: 0 in 0.417s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_ruv2pp9d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:04 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_ruv2pp9d Sep 25 11:49:04 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:04 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501" returned: 0 in 0.603s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:04 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501 Sep 25 11:49:04 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:04 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_ruv2pp9d" returned: 1 in 0.460s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52fc0ca7-cc30-4877-96ee-a5ea6e458871_ruv2pp9d' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90a6232-91c1-4107-9bdb-ea502ba74b71]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:05 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD Sep 25 11:49:05 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:05 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.22e598e5-0674-4c12-81f0-4ad570bd2501" returned: 0 in 0.315s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-22e598e5-0674-4c12-81f0-4ad570bd2501" released by "_delete_snapshot" :: held 2.143s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" released by "delete_snapshot" :: held 2.196s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:05 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Created reservations ['ab5fd905-30e2-4f56-bb73-a3a0f50206dd', '73e51c5a-e35d-45d2-92b1-83df1134c6f0', '4f0f477c-108a-4cc2-bb81-d9612bab740c', '6b4585cf-9fb6-44f5-9d3d-7b08e8548cf7'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Delete snapshot completed successfully. Sep 25 11:49:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3b3c2841-90e5-421e-8687-1b1170122f87 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-22e598e5-0674-4c12-81f0-4ad570bd2501-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:05 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:05 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] 52fc0ca7-cc30-4877-96ee-a5ea6e458871 was qcow2, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:49:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:05 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a Sep 25 11:49:05 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-2c3d6422-5e89-4b54-9189-6a39d7e8dfba-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-2c3d6422-5e89-4b54-9189-6a39d7e8dfba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-quobyte-2c3d6422-5e89-4b54-9189-6a39d7e8dfba" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-2c3d6422-5e89-4b54-9189-6a39d7e8dfba" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Deleting offline snapshot 2c3d6422-5e89-4b54-9189-6a39d7e8dfba of volume ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] snapshot_file for this snap is: volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bb66b8-c69d-4c94-b61b-816c65a20420]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:06 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba Sep 25 11:49:06 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Flow 'volume_create_manager' (4068803a-15c9-4179-9493-d405b6a119ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a441be1d-dc62-4165-8152-e84a9508a5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a441be1d-dc62-4165-8152-e84a9508a5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2135958370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca31e8f4-6c18-45e0-93e2-5501fd8dfc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352b376b4be449ba9d74c66b589085e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:07Z,use_quota=True,user_id='4eeb804c0e7d49ffa9e6eca8c9f42149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b661eda9-90ce-4a02-b887-b95ae5a48bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b661eda9-90ce-4a02-b887-b95ae5a48bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8d631d-ea8f-4d5c-ad5e-5d4d13289b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8d631d-ea8f-4d5c-ad5e-5d4d13289b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca31e8f4-6c18-45e0-93e2-5501fd8dfc83', 'volume_name': 'volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c746e1-3c4e-40f6-9508-042b2c7a3ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c746e1-3c4e-40f6-9508-042b2c7a3ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fa9e9e-b1d6-4b16-bf36-e132bc2df7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:06 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Volume ca31e8f4-6c18-45e0-93e2-5501fd8dfc83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83', 'volume_size': 1} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2135958370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca31e8f4-6c18-45e0-93e2-5501fd8dfc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352b376b4be449ba9d74c66b589085e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:07Z,use_quota=True,user_id='4eeb804c0e7d49ffa9e6eca8c9f42149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Creating volume ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:06 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:06 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 1073741824 Sep 25 11:49:06 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:06 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba" returned: 0 in 0.578s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad979375-7c05-47e6-8760-38033e21e478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ebc164-5551-459b-8320-8f9ae4c9ceb6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:07 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 Sep 25 11:49:07 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:07 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5" returned: 0 in 0.451s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad979375-7c05-47e6-8760-38033e21e478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:07 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba Sep 25 11:49:07 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:07 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 1073741824" returned: 0 in 0.636s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:07 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 Sep 25 11:49:07 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:07 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" returned: 0 in 0.359s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fa9e9e-b1d6-4b16-bf36-e132bc2df7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d52af82-b780-4744-be21-75894739e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:07 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Volume volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 (ca31e8f4-6c18-45e0-93e2-5501fd8dfc83): created successfully Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d52af82-b780-4744-be21-75894739e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Flow 'volume_create_manager' (4068803a-15c9-4179-9493-d405b6a119ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:07 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a" returned: 0 in 2.511s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52fc0ca7-cc30-4877-96ee-a5ea6e458871_wl4_jv4odevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:49:07 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Converted 112.00 MB image at 44.59 MB/s Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4a370cdd-6585-4800-8759-665ca2e0fd71 tempest-TestStampPattern-1881844105 None] Created volume successfully. Sep 25 11:49:07 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a 1G Sep 25 11:49:07 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:07 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba" returned: 0 in 0.634s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:07 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba Sep 25 11:49:07 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:08 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a 1G" returned: 0 in 0.433s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Downloaded image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 ((None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}])) to volume fe52cf27-a514-4290-bc55-99050065193a successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Temporary image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 for user 0d3781e2f2da46859769c1386d53a1dc is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Marking volume fe52cf27-a514-4290-bc55-99050065193a as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:49:08 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.2c3d6422-5e89-4b54-9189-6a39d7e8dfba" returned: 0 in 0.376s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Copying metadata from image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 to fe52cf27-a514-4290-bc55-99050065193a. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Creating volume glance metadata for volume fe52cf27-a514-4290-bc55-99050065193a backed by image 52fc0ca7-cc30-4877-96ee-a5ea6e458871 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-2c3d6422-5e89-4b54-9189-6a39d7e8dfba" released by "_delete_snapshot" :: held 2.185s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" released by "delete_snapshot" :: held 2.219s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Created reservations ['1319b4ac-0ca0-421f-9618-9e5dc736c8c4', '2d352c28-2c0c-430a-adce-03e52046c4b3', '21f33171-14b2-4ebb-af03-286e1a856a4a', '821bd087-0f26-488d-aaa3-d06aab1384a4'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9a2852-ba96-49a3-9df0-36a1984e97ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe52cf27-a514-4290-bc55-99050065193a', 'volume_size': 1, 'image_id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '719b55b6af3b40ee9049b782dc10a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52fc0ca7-cc30-4877-96ee-a5ea6e458871', 'created_at': datetime.datetime(2026, 9, 25, 9, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 26, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52fc0ca7-cc30-4877-96ee-a5ea6e458871/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09625fc2-c3bc-4a98-8365-2d58e92bac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:08 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Volume volume-fe52cf27-a514-4290-bc55-99050065193a (fe52cf27-a514-4290-bc55-99050065193a): created successfully Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09625fc2-c3bc-4a98-8365-2d58e92bac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (1f9dfc0b-73a2-40ed-a1e8-ca5db53af246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:08 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-7c49db95-1bb1-4e28-b8a1-fc8a5f5b886f tempest-VolumesGetTest-593811276 None] Created volume successfully. Sep 25 11:49:08 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Delete snapshot completed successfully. Sep 25 11:49:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d405df23-f4a1-4495-8537-71f6d7985416 tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-2c3d6422-5e89-4b54-9189-6a39d7e8dfba-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-17b1e514-7477-4b04-a74b-d273dea0a6f5-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-17b1e514-7477-4b04-a74b-d273dea0a6f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-quobyte-17b1e514-7477-4b04-a74b-d273dea0a6f5" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-17b1e514-7477-4b04-a74b-d273dea0a6f5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Deleting offline snapshot 17b1e514-7477-4b04-a74b-d273dea0a6f5 of volume ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] snapshot_file for this snap is: volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe24883c-d5c2-4af0-8904-2608d9474c83]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:09 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 Sep 25 11:49:09 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:10 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5" returned: 0 in 0.375s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad979375-7c05-47e6-8760-38033e21e478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdedf05a-e08d-40fb-a78d-b450b1fcdfa9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:10 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 Sep 25 11:49:10 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:10 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478" returned: 0 in 0.668s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:10 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 Sep 25 11:49:10 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (2e6cd84b-e7c4-412e-9ef5-0791827395f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27b08f9-93a1-4bbd-a07b-dfabc0d5058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27b08f9-93a1-4bbd-a07b-dfabc0d5058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-453264335',display_name='tempest-VolumesGetTest-Volume-750770404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db68e86f-ade4-46d7-a897-8d12ff55933d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:11Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f66652-a45a-480d-8de7-4f3dfcd3d063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f66652-a45a-480d-8de7-4f3dfcd3d063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078c8034-86f9-4692-a277-c46a89d74afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078c8034-86f9-4692-a277-c46a89d74afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db68e86f-ade4-46d7-a897-8d12ff55933d', 'volume_name': 'volume-db68e86f-ade4-46d7-a897-8d12ff55933d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62f2e30-5d32-46d1-b4a5-004e74399bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62f2e30-5d32-46d1-b4a5-004e74399bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3320036e-eac8-42e7-b32a-23c0917a8771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:11 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Volume db68e86f-ade4-46d7-a897-8d12ff55933d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db68e86f-ade4-46d7-a897-8d12ff55933d', 'volume_size': 1} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-453264335',display_name='tempest-VolumesGetTest-Volume-750770404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db68e86f-ade4-46d7-a897-8d12ff55933d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c79a56608643fc9f05f66152759846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:11Z,use_quota=True,user_id='0d3781e2f2da46859769c1386d53a1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Creating volume db68e86f-ade4-46d7-a897-8d12ff55933d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:11 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:11 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d 1073741824 Sep 25 11:49:11 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:11 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5" returned: 0 in 0.655s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:11 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5 Sep 25 11:49:11 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:11 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d 1073741824" returned: 0 in 0.812s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:11 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d Sep 25 11:49:11 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:12 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478.17b1e514-7477-4b04-a74b-d273dea0a6f5" returned: 0 in 0.545s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-17b1e514-7477-4b04-a74b-d273dea0a6f5" released by "_delete_snapshot" :: held 2.394s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" released by "delete_snapshot" :: held 2.426s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:12 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d" returned: 0 in 0.369s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3320036e-eac8-42e7-b32a-23c0917a8771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db68e86f-ade4-46d7-a897-8d12ff55933d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097da861-b570-4eb8-ba69-3876966f8995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Created reservations ['0b69da4f-f1f8-4c4f-876a-6a88ff80b931', 'f4b750bc-79fb-487b-9924-35ee13b189e2', '1a3eccff-76f8-4d6f-9998-2d0d01d01902', 'f138b0bd-812a-4776-a908-97e002ddc69b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:12 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Volume volume-db68e86f-ade4-46d7-a897-8d12ff55933d (db68e86f-ade4-46d7-a897-8d12ff55933d): created successfully Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097da861-b570-4eb8-ba69-3876966f8995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Flow 'volume_create_manager' (2e6cd84b-e7c4-412e-9ef5-0791827395f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:12 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ebcfff9f-e0a2-44cb-a58f-91bfb239b122 tempest-VolumesGetTest-593811276 None] Created volume successfully. Sep 25 11:49:12 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Delete snapshot completed successfully. Sep 25 11:49:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-344f7c8d-c44f-4121-b805-59acc9c060af tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-17b1e514-7477-4b04-a74b-d273dea0a6f5-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-ad979375-7c05-47e6-8760-38033e21e478-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-ad979375-7c05-47e6-8760-38033e21e478-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-db68e86f-ade4-46d7-a897-8d12ff55933d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Lock "cinder-db68e86f-ade4-46d7-a897-8d12ff55933d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26cc0a3-cde9-4804-afec-1c8602230cd5]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-db68e86f-ade4-46d7-a897-8d12ff55933d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-db68e86f-ade4-46d7-a897-8d12ff55933d" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0703769-2b21-477f-b0f5-1e269efe8267]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:13 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 Sep 25 11:49:13 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:13 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d Sep 25 11:49:13 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:13 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478" returned: 0 in 0.595s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:13 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478 Sep 25 11:49:13 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:13 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d" returned: 0 in 0.609s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:14 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d Sep 25 11:49:14 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ad979375-7c05-47e6-8760-38033e21e478" returned: 0 in 0.417s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:14 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-quobyte-ad979375-7c05-47e6-8760-38033e21e478" released by "delete_volume" :: held 1.140s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Created reservations ['a90e5b2f-5fe8-4e91-ada8-223b8c232189', '842dd4b8-53f3-4237-bbf5-0782332ad75d', 'bbfaf885-b1ea-41a8-869f-7a829747473c', '02cb7a81-b158-4d04-b040-ca8f9c538304'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:14 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-db68e86f-ade4-46d7-a897-8d12ff55933d" returned: 0 in 0.551s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-db68e86f-ade4-46d7-a897-8d12ff55933d" released by "delete_volume" :: held 1.229s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:14 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Created reservations ['74b83149-f257-4b79-a846-d3f987237996', '0344dad6-ef43-46a8-9835-211613011057', 'f37460b4-1d79-4305-8a43-7b95714a5c33', '8bfb4c61-72cd-47b9-a63f-d2bae3a44fe6'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:14 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:49:14 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:15 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:49:15 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:15 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.609s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Deleted volume successfully. Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-941fd318-220e-494e-9d85-9c3c3870c02e tempest-VolumesSnapshotListTestJSON-1153147604 None] Lock "cinder-ad979375-7c05-47e6-8760-38033e21e478-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:15 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.556s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Deleted volume successfully. Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e9b2cd2d-1754-4595-8d7d-9de159fb907e tempest-VolumesGetTest-593811276 None] Lock "cinder-db68e86f-ade4-46d7-a897-8d12ff55933d-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-fe52cf27-a514-4290-bc55-99050065193a-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Lock "cinder-fe52cf27-a514-4290-bc55-99050065193a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Acquiring lock "cinder-quobyte-fe52cf27-a514-4290-bc55-99050065193a" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-fe52cf27-a514-4290-bc55-99050065193a" acquired by "delete_volume" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:16 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c347054e-efb1-4b94-b8d3-cd602dc92455]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:16 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a Sep 25 11:49:16 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:16 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a" returned: 0 in 0.503s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:16 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a Sep 25 11:49:16 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:16 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fe52cf27-a514-4290-bc55-99050065193a" returned: 0 in 0.338s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Lock "cinder-quobyte-fe52cf27-a514-4290-bc55-99050065193a" released by "delete_volume" :: held 0.928s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Created reservations ['325f058b-cbf8-4242-8ade-0db95ccf86d7', '58dd29e4-39a3-4735-bd22-3df488bc7f14', 'e295ed58-70b7-4ed6-876a-fa57f77932e1', '1f23f4e4-0eeb-469e-969c-09ad86052647'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:17 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:49:17 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:17 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.388s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Deleted volume successfully. Sep 25 11:49:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ffcb1c43-bdb2-4858-832e-8fb4bf969d3e tempest-VolumesGetTest-593811276 None] Lock "cinder-fe52cf27-a514-4290-bc55-99050065193a-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:23 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:49:23 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:23 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.506s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:49:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Flow 'volume_create_manager' (e6265cdf-f0c3-4569-b533-7270f4dba957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5639649-4d4f-4a81-9405-a5ab900189e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5639649-4d4f-4a81-9405-a5ab900189e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-121195261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f7ab58-2a27-4eae-a4db-5ade87d505a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a1fa698ade74fb5bbdfa931aebe63a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:25Z,use_quota=True,user_id='b7d2ecbf255e4c5094e0a3fd957be384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c702f19f-8266-4935-9a26-8d83c79ca23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c702f19f-8266-4935-9a26-8d83c79ca23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf577b56-8305-477d-952b-2628c2d8dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf577b56-8305-477d-952b-2628c2d8dfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f7ab58-2a27-4eae-a4db-5ade87d505a1', 'volume_name': 'volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a5a93a-d5dd-43bf-ac52-56bab287c8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a5a93a-d5dd-43bf-ac52-56bab287c8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202180e2-2007-4a8c-aaa9-9d8f3940e378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:24 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Volume 15f7ab58-2a27-4eae-a4db-5ade87d505a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1', 'volume_size': 1} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-121195261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f7ab58-2a27-4eae-a4db-5ade87d505a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a1fa698ade74fb5bbdfa931aebe63a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:25Z,use_quota=True,user_id='b7d2ecbf255e4c5094e0a3fd957be384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Creating volume 15f7ab58-2a27-4eae-a4db-5ade87d505a1 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:24 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:49:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:25 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 1073741824 Sep 25 11:49:25 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:25 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 1073741824" returned: 0 in 0.652s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:25 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 Sep 25 11:49:25 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:26 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1" returned: 0 in 0.367s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202180e2-2007-4a8c-aaa9-9d8f3940e378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db187615-aafe-4092-9103-50105edced72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:26 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Volume volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 (15f7ab58-2a27-4eae-a4db-5ade87d505a1): created successfully Sep 25 11:49:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db187615-aafe-4092-9103-50105edced72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Flow 'volume_create_manager' (e6265cdf-f0c3-4569-b533-7270f4dba957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-21242ddc-fc41-4e93-bd15-cf0a665f05f8 tempest-VolumesListTestJSON-1832368601 None] Created volume successfully. Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Flow 'volume_create_manager' (91a7c83f-1b76-4816-ac39-701223d9cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f61db6e-dbf7-40f1-9c97-d851c00c2735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f61db6e-dbf7-40f1-9c97-d851c00c2735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082243686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a1fa698ade74fb5bbdfa931aebe63a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:28Z,use_quota=True,user_id='b7d2ecbf255e4c5094e0a3fd957be384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf388642-66dd-4ff0-adf8-8b47a7fbbe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf388642-66dd-4ff0-adf8-8b47a7fbbe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a221a7-e738-4d78-ad77-781b5700d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a221a7-e738-4d78-ad77-781b5700d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb', 'volume_name': 'volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a255b63c-07d7-4726-850b-3cb7d054ab6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a255b63c-07d7-4726-850b-3cb7d054ab6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c6f6e1-f302-4ff0-91d0-de46c84e6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:28 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Volume dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb', 'volume_size': 1} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082243686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a1fa698ade74fb5bbdfa931aebe63a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:28Z,use_quota=True,user_id='b7d2ecbf255e4c5094e0a3fd957be384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Creating volume dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:28 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:49:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:28 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb 1073741824 Sep 25 11:49:28 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:29 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb 1073741824" returned: 0 in 0.786s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:29 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb Sep 25 11:49:29 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:29 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb" returned: 0 in 0.405s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c6f6e1-f302-4ff0-91d0-de46c84e6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83ef0fc-5f95-4518-9e77-7632a67ced55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:29 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Volume volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb (dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb): created successfully Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83ef0fc-5f95-4518-9e77-7632a67ced55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Flow 'volume_create_manager' (91a7c83f-1b76-4816-ac39-701223d9cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f3ab8342-c4d9-4c68-9b39-c566b3848942 tempest-VolumesListTestJSON-1832368601 None] Created volume successfully. Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Flow 'volume_create_manager' (dd29b5f7-deac-43a8-bd6e-509141a19d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f77e53-522a-47ba-aada-ff1ffde30325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f77e53-522a-47ba-aada-ff1ffde30325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-532244909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cc8cf5-ce83-480d-a11c-7500c7c83430,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a1fa698ade74fb5bbdfa931aebe63a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:31Z,use_quota=True,user_id='b7d2ecbf255e4c5094e0a3fd957be384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135772f7-9ec8-4d99-86fb-1c88db6ea9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135772f7-9ec8-4d99-86fb-1c88db6ea9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989791c0-06d8-47ff-8279-ce08fe69a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989791c0-06d8-47ff-8279-ce08fe69a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19cc8cf5-ce83-480d-a11c-7500c7c83430', 'volume_name': 'volume-19cc8cf5-ce83-480d-a11c-7500c7c83430', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a630b5-6ffe-4a0c-a5a6-442aa927b146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a630b5-6ffe-4a0c-a5a6-442aa927b146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7fdbcb-e6a7-4b94-b03a-9e24cf9b3a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Volume 19cc8cf5-ce83-480d-a11c-7500c7c83430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19cc8cf5-ce83-480d-a11c-7500c7c83430', 'volume_size': 1} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-532244909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cc8cf5-ce83-480d-a11c-7500c7c83430,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a1fa698ade74fb5bbdfa931aebe63a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:31Z,use_quota=True,user_id='b7d2ecbf255e4c5094e0a3fd957be384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Creating volume 19cc8cf5-ce83-480d-a11c-7500c7c83430 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:31 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:49:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:31 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 1073741824 Sep 25 11:49:31 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:32 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 1073741824" returned: 0 in 0.633s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:32 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 Sep 25 11:49:32 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:32 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430" returned: 0 in 0.341s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7fdbcb-e6a7-4b94-b03a-9e24cf9b3a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19cc8cf5-ce83-480d-a11c-7500c7c83430', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83355fc0-ed30-4321-a791-5897d7b49197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:32 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Volume volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 (19cc8cf5-ce83-480d-a11c-7500c7c83430): created successfully Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83355fc0-ed30-4321-a791-5897d7b49197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Flow 'volume_create_manager' (dd29b5f7-deac-43a8-bd6e-509141a19d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:32 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-abaf58a1-8b95-4bc2-8c6d-45fb6d253357 tempest-VolumesListTestJSON-1832368601 None] Created volume successfully. Sep 25 11:49:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "cinder-19cc8cf5-ce83-480d-a11c-7500c7c83430-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-19cc8cf5-ce83-480d-a11c-7500c7c83430-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "cinder-quobyte-19cc8cf5-ce83-480d-a11c-7500c7c83430" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-quobyte-19cc8cf5-ce83-480d-a11c-7500c7c83430" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d44a1-c902-47f2-af30-1e92ab93c9ef]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:36 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 Sep 25 11:49:36 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:36 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430" returned: 0 in 0.447s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:36 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430 Sep 25 11:49:36 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:36 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-19cc8cf5-ce83-480d-a11c-7500c7c83430" returned: 0 in 0.313s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-quobyte-19cc8cf5-ce83-480d-a11c-7500c7c83430" released by "delete_volume" :: held 0.825s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Created reservations ['4615939d-5d64-42c6-b981-324e69a83ef5', '2c364e81-52bb-4e05-a91f-a9303154c78c', 'c2cd3827-c71c-4890-870d-3eb38c1fb6e7', 'b4d68c5d-0e4b-487d-a6a4-6363e895e74f'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:37 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:49:37 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "cinder-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:37 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.321s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "cinder-quobyte-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Deleted volume successfully. Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-quobyte-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-76f25157-f017-469e-9026-b8ecf277ce02 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-19cc8cf5-ce83-480d-a11c-7500c7c83430-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[74db8c45-5880-4b10-a185-f3c9dbd19d57]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:37 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb Sep 25 11:49:37 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:37 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb" returned: 0 in 0.434s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:37 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb Sep 25 11:49:37 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:38 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb" returned: 0 in 0.312s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-quobyte-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb" released by "delete_volume" :: held 0.805s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Created reservations ['e93b5691-2aa6-4093-b2a3-05d033162938', '59ef5fee-7cbf-45a0-9445-fd9630f56ce7', 'd69bf3e6-f211-43fb-8803-1e549473b5ed', 'd5a4550f-d97d-4a16-a41c-533c662414d6'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:38 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:49:38 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "cinder-15f7ab58-2a27-4eae-a4db-5ade87d505a1-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-15f7ab58-2a27-4eae-a4db-5ade87d505a1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "cinder-quobyte-15f7ab58-2a27-4eae-a4db-5ade87d505a1" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-quobyte-15f7ab58-2a27-4eae-a4db-5ade87d505a1" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[610e1f08-d825-4524-8eaa-f1a143d31b0c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:38 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.417s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:38 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Deleted volume successfully. Sep 25 11:49:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a47a3ff4-cd80-4f30-abbd-28191d8c9b50 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-dc55a4d3-be46-4ce1-bff2-ac6ddc8f34bb-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:38 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 Sep 25 11:49:38 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:39 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1" returned: 0 in 0.516s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:39 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1 Sep 25 11:49:39 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:39 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-15f7ab58-2a27-4eae-a4db-5ade87d505a1" returned: 0 in 0.406s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-quobyte-15f7ab58-2a27-4eae-a4db-5ade87d505a1" released by "delete_volume" :: held 1.000s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Created reservations ['5daaf0dd-ff7b-4dbf-9756-850d28b6895c', '89fc5abb-1fdf-4cb6-bf98-e80f8d3b9ce6', 'bc714ae8-6416-441f-a203-c979946750bc', 'db7b2067-4f4d-4954-96a2-18994e2dfccc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:39 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:49:39 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:40 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.358s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:40 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:40 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Deleted volume successfully. Sep 25 11:49:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-71301bd3-162f-4aea-a617-f643680aeb09 tempest-VolumesListTestJSON-1832368601 None] Lock "cinder-15f7ab58-2a27-4eae-a4db-5ade87d505a1-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-89ee0b63-a330-45e0-9214-61ac0dea5598 req-6594853f-948b-4d63-ae04-6056099565c6 tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-89ee0b63-a330-45e0-9214-61ac0dea5598 req-6594853f-948b-4d63-ae04-6056099565c6 tempest-TestStampPattern-1881844105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-89ee0b63-a330-45e0-9214-61ac0dea5598 req-6594853f-948b-4d63-ae04-6056099565c6 tempest-TestStampPattern-1881844105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:45 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-89ee0b63-a330-45e0-9214-61ac0dea5598 req-6594853f-948b-4d63-ae04-6056099565c6 tempest-TestStampPattern-1881844105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '121ed472-a08c-44c1-88c3-4d3a1a0826df', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:49:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-89ee0b63-a330-45e0-9214-61ac0dea5598 req-6594853f-948b-4d63-ae04-6056099565c6 tempest-TestStampPattern-1881844105 None] attachment_update completed successfully. Sep 25 11:49:50 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=124,cinder:DELETE=9,cinder:SELECT=105,cinder:INSERT=35 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:49:50 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=89,cinder:UPDATE=111,cinder:INSERT=34,cinder:DELETE=11 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:49:50 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Flow 'volume_create_manager' (2dfa2c16-bf00-4f0f-8a49-7a8f3207dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6380eaad-6c2b-432d-9940-57f3f8ebc122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6380eaad-6c2b-432d-9940-57f3f8ebc122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-756091343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64057c3b-a3bb-475c-81ec-2855d20231c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd22d017de6400a8ce48c9eda1e14e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:51Z,use_quota=True,user_id='e4284a2229534858bb5686786583fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85305cb-05a8-484a-9564-fd91383387c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85305cb-05a8-484a-9564-fd91383387c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb9ae64-31de-433f-9255-e14b7eb9166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb9ae64-31de-433f-9255-e14b7eb9166d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64057c3b-a3bb-475c-81ec-2855d20231c5', 'volume_name': 'volume-64057c3b-a3bb-475c-81ec-2855d20231c5', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e2d469-8c83-4945-af62-ece2ffe472cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e2d469-8c83-4945-af62-ece2ffe472cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1684bb-53c5-4488-a85d-f1a6b92f67f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:51 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Volume 64057c3b-a3bb-475c-81ec-2855d20231c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64057c3b-a3bb-475c-81ec-2855d20231c5', 'volume_size': 1} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-756091343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64057c3b-a3bb-475c-81ec-2855d20231c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd22d017de6400a8ce48c9eda1e14e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:51Z,use_quota=True,user_id='e4284a2229534858bb5686786583fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Creating volume 64057c3b-a3bb-475c-81ec-2855d20231c5 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:51 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:51 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 1073741824 Sep 25 11:49:51 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:51 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 1073741824" returned: 0 in 0.651s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:51 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 Sep 25 11:49:51 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-daabaa66-d0e3-45aa-99ed-ae78c3ca71c4 req-837a06ea-c498-4738-8a27-82ad46899036 tempest-TestStampPattern-1881844105 None] Terminate volume connection completed successfully. Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-daabaa66-d0e3-45aa-99ed-ae78c3ca71c4 req-837a06ea-c498-4738-8a27-82ad46899036 tempest-TestStampPattern-1881844105 None] Deleting attachment 121ed472-a08c-44c1-88c3-4d3a1a0826df. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:49:52 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5" returned: 0 in 0.412s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1684bb-53c5-4488-a85d-f1a6b92f67f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64057c3b-a3bb-475c-81ec-2855d20231c5', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52066cb-ebe4-43bc-97c0-784f93941b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:52 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Volume volume-64057c3b-a3bb-475c-81ec-2855d20231c5 (64057c3b-a3bb-475c-81ec-2855d20231c5): created successfully Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52066cb-ebe4-43bc-97c0-784f93941b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Flow 'volume_create_manager' (2dfa2c16-bf00-4f0f-8a49-7a8f3207dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-37ed4eb0-a3f8-41bc-b454-442041c4c869 tempest-TestImageHashVerification-759955815 None] Created volume successfully. Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Creating offline snapshot 11032781-487c-4304-ac39-20401fedd87f of volume ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:49:53 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf457f2-f49d-4e17-b464-991da60b3b70]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:53 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 Sep 25 11:49:53 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:53 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" returned: 0 in 0.556s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:53 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f 1G Sep 25 11:49:53 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:54 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f 1G" returned: 0 in 0.613s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:54 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f Sep 25 11:49:54 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:54 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f" returned: 0 in 0.414s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:54 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f is being set with open permissions: ugo+rw Sep 25 11:49:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:54 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f Sep 25 11:49:54 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:55 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f" returned: 0 in 0.353s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:55 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.info Sep 25 11:49:55 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:55 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.info" returned: 0 in 0.357s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:55 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.info is being set with open permissions: ugo+rw Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:55 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.info Sep 25 11:49:55 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:55 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.info" returned: 0 in 0.294s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.402s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[891592a9-940e-4536-b808-28316d96454f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c2bd5d33-3d51-4070-a5f7-0d1211b0d1e5 tempest-TestStampPattern-1881844105 None] Create snapshot completed successfully Sep 25 11:49:55 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 Sep 25 11:49:55 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:56 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5" returned: 0 in 0.497s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf8b83d-3d56-451c-bf97-f36143eed5e2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:56 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 Sep 25 11:49:56 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:56 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5" returned: 0 in 0.489s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 /opt/stack/data/cinder/conversion/64057c3b-a3bb-475c-81ec-2855d20231c5.temp_image.95891053-dd42-482e-a739-0d409c231dc7ku27o2_j.img {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:56 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 /opt/stack/data/cinder/conversion/64057c3b-a3bb-475c-81ec-2855d20231c5.temp_image.95891053-dd42-482e-a739-0d409c231dc7ku27o2_j.img Sep 25 11:49:56 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:05 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 /opt/stack/data/cinder/conversion/64057c3b-a3bb-475c-81ec-2855d20231c5.temp_image.95891053-dd42-482e-a739-0d409c231dc7ku27o2_j.img" returned: 0 in 8.864s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:05 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[880fe0fc-737a-4324-a0c0-8e5fc171e0bf]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:05 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:50:05 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:DELETE=2 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:50:05 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 Sep 25 11:50:05 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:06 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5" returned: 0 in 0.863s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:06 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/conversion/64057c3b-a3bb-475c-81ec-2855d20231c5.temp_image.95891053-dd42-482e-a739-0d409c231dc7ku27o2_j.img {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:50:06 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Converted 1024.00 MB image at 115.50 MB/s Sep 25 11:50:06 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] 95891053-dd42-482e-a739-0d409c231dc7 was raw, no need to convert to raw {{(pid=87356) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Flow 'volume_create_manager' (3e9f7caa-41a4-416a-afc3-5681e3994ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f884045-2fa4-4581-a073-c1dfac284c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f884045-2fa4-4581-a073-c1dfac284c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1855972381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352b376b4be449ba9d74c66b589085e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11032781-487c-4304-ac39-20401fedd87f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:08Z,use_quota=True,user_id='4eeb804c0e7d49ffa9e6eca8c9f42149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2e0938-8cf5-4bf8-bf44-c81438345766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2e0938-8cf5-4bf8-bf44-c81438345766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255824d1-9aff-4d52-800f-bdfcf9f77b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255824d1-9aff-4d52-800f-bdfcf9f77b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7', 'volume_name': 'volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7', 'volume_size': 1, 'snapshot_id': '11032781-487c-4304-ac39-20401fedd87f'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8ef22d-ccec-4fe9-90f1-98ce109a904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8ef22d-ccec-4fe9-90f1-98ce109a904a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b23749d-9a50-4b02-a924-72b86949a251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:08 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Volume 2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7', 'volume_size': 1, 'snapshot_id': '11032781-487c-4304-ac39-20401fedd87f'} Sep 25 11:50:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:18 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=3 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:50:18 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:50:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:50:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:23 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:50:23 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:24 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.739s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:24 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:50:24 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:50:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:50:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:50:40 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Flow 'volume_create_manager' (601345ed-0d8a-457e-b890-f66abf549d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a3adb7-17ed-492e-ab66-e3640a765433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a3adb7-17ed-492e-ab66-e3640a765433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1467100691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7532e5-fc21-491a-aa38-92ae98419cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285f25a0c8d542d3bf072c741578020a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:41Z,use_quota=True,user_id='a2e3b5177aca4ffcb17ec1c5755cc1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee6165e-6bec-4cc1-8b5d-717590cec88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee6165e-6bec-4cc1-8b5d-717590cec88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32da0f5-d5f0-4ca2-a3d9-e0a74b427bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32da0f5-d5f0-4ca2-a3d9-e0a74b427bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7532e5-fc21-491a-aa38-92ae98419cf2', 'volume_name': 'volume-5d7532e5-fc21-491a-aa38-92ae98419cf2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab98dee-6323-4d56-b7e8-28ffbb64d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab98dee-6323-4d56-b7e8-28ffbb64d24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ca633-e5a1-4ac0-a0a8-63cf19c2bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Volume 5d7532e5-fc21-491a-aa38-92ae98419cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7532e5-fc21-491a-aa38-92ae98419cf2', 'volume_size': 1} Sep 25 11:50:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 47.137s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Uploaded volume to glance image-id: 95891053-dd42-482e-a739-0d409c231dc7. {{(pid=87356) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 34.487s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-quobyte-11032781-487c-4304-ac39-20401fedd87f-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-11032781-487c-4304-ac39-20401fedd87f-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Creating volume 2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 from snapshot 11032781-487c-4304-ac39-20401fedd87f {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-quobyte-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:42 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-5357c666-4169-444e-ad5d-63d0491e0afd tempest-TestImageHashVerification-759955815 None] Copy volume to image completed successfully. Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] snapshot: 11032781-487c-4304-ac39-20401fedd87f, volume: 2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c8ee9b-1e41-4c0b-80b4-55d516b87d18]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:43 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f Sep 25 11:50:43 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:43 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f" returned: 0 in 0.425s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3bc4d4-0bc5-453d-8b84-9104bdaf01d8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:43 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 Sep 25 11:50:43 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:43 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" returned: 0 in 0.458s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:50:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:43 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 Sep 25 11:50:43 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Acquiring lock "cinder-64057c3b-a3bb-475c-81ec-2855d20231c5-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Lock "cinder-64057c3b-a3bb-475c-81ec-2855d20231c5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Acquiring lock "cinder-quobyte-64057c3b-a3bb-475c-81ec-2855d20231c5" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Lock "cinder-quobyte-64057c3b-a3bb-475c-81ec-2855d20231c5" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:44 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b30ff3-8644-4330-bf8c-427c2fe1c8a3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:44 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 Sep 25 11:50:44 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:44 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5" returned: 0 in 0.576s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:44 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5 Sep 25 11:50:44 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:45 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-64057c3b-a3bb-475c-81ec-2855d20231c5" returned: 0 in 0.609s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Lock "cinder-quobyte-64057c3b-a3bb-475c-81ec-2855d20231c5" released by "delete_volume" :: held 1.263s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Created reservations ['0555d247-7d6e-46b2-94c9-6a41bdf4a8d1', '2f32b626-d7fc-4012-a2c0-65bba1e85c94', '38e7042e-c5d4-4cb5-bb0f-0e766a61a44f', 'b76191ff-5743-43be-b127-fa691f7b7b9a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:45 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:50:45 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:46 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.529s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:46 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:50:46 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Deleted volume successfully. Sep 25 11:50:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3faf53d5-aea2-47c3-aea3-14aac21f527a tempest-TestImageHashVerification-759955815 None] Lock "cinder-64057c3b-a3bb-475c-81ec-2855d20231c5-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:54 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" returned: 0 in 10.203s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83, size 1024.00 MB, duration 10.20 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:50:54 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Converted 1024.00 MB image at 100.35 MB/s Sep 25 11:50:54 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 is being set with open permissions: ugo+rw Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:54 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 Sep 25 11:50:54 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:54 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" returned: 0 in 0.322s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" released by "_copy_volume_from_snapshot" :: held 11.518s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-11032781-487c-4304-ac39-20401fedd87f-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" released by "_create_volume_from_snapshot" :: held 11.592s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.628s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.443s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1467100691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7532e5-fc21-491a-aa38-92ae98419cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285f25a0c8d542d3bf072c741578020a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:41Z,use_quota=True,user_id='a2e3b5177aca4ffcb17ec1c5755cc1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Creating volume 5d7532e5-fc21-491a-aa38-92ae98419cf2 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:54 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:54 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 1073741824 Sep 25 11:50:54 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b23749d-9a50-4b02-a924-72b86949a251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7', 'volume_size': 1, 'snapshot_id': '11032781-487c-4304-ac39-20401fedd87f'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b80ae9-b24f-448e-83c5-85a31a74b9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:54 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Volume volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 (2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7): created successfully Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b80ae9-b24f-448e-83c5-85a31a74b9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Flow 'volume_create_manager' (3e9f7caa-41a4-416a-afc3-5681e3994ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0dcb64a9-d867-4864-8328-57433d1aaca1 tempest-TestStampPattern-1881844105 None] Created volume successfully. Sep 25 11:50:55 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 1073741824" returned: 0 in 0.556s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:55 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 Sep 25 11:50:55 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:55 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2" returned: 0 in 0.396s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ca633-e5a1-4ac0-a0a8-63cf19c2bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7532e5-fc21-491a-aa38-92ae98419cf2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cec2e70-62ec-4eda-b629-cb551428ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:55 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Volume volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 (5d7532e5-fc21-491a-aa38-92ae98419cf2): created successfully Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cec2e70-62ec-4eda-b629-cb551428ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Flow 'volume_create_manager' (601345ed-0d8a-457e-b890-f66abf549d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8b9242f4-69c3-4608-b33b-bc728caddab4 tempest-TestMinimumBasicScenario-103785383 None] Created volume successfully. Sep 25 11:50:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-2a688fcf-e2a9-404a-9240-c56525479325 req-de2c3438-486f-48d8-be53-28020f644fbe tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-2a688fcf-e2a9-404a-9240-c56525479325 req-de2c3438-486f-48d8-be53-28020f644fbe tempest-TestStampPattern-1881844105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-2a688fcf-e2a9-404a-9240-c56525479325 req-de2c3438-486f-48d8-be53-28020f644fbe tempest-TestStampPattern-1881844105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-2a688fcf-e2a9-404a-9240-c56525479325 req-de2c3438-486f-48d8-be53-28020f644fbe tempest-TestStampPattern-1881844105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '484f6bf9-2cb7-44f9-8e74-3247699c18b9', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:50:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-2a688fcf-e2a9-404a-9240-c56525479325 req-de2c3438-486f-48d8-be53-28020f644fbe tempest-TestStampPattern-1881844105 None] attachment_update completed successfully. Sep 25 11:50:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b74e2e39-2ecf-4f6e-924d-1dbc43cc8fc5 req-632e84c0-638f-4e2f-87a3-0a5855a5e271 tempest-TestMinimumBasicScenario-103785383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b74e2e39-2ecf-4f6e-924d-1dbc43cc8fc5 req-632e84c0-638f-4e2f-87a3-0a5855a5e271 tempest-TestMinimumBasicScenario-103785383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [req-b74e2e39-2ecf-4f6e-924d-1dbc43cc8fc5 req-632e84c0-638f-4e2f-87a3-0a5855a5e271 tempest-TestMinimumBasicScenario-103785383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-b74e2e39-2ecf-4f6e-924d-1dbc43cc8fc5 req-632e84c0-638f-4e2f-87a3-0a5855a5e271 tempest-TestMinimumBasicScenario-103785383 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724', 'name': 'volume-5d7532e5-fc21-491a-aa38-92ae98419cf2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1195763-da56-4f4f-a4bb-fd32e0b315b1', 'enforce_multipath': True} {{(pid=87356) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:50:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-b74e2e39-2ecf-4f6e-924d-1dbc43cc8fc5 req-632e84c0-638f-4e2f-87a3-0a5855a5e271 tempest-TestMinimumBasicScenario-103785383 None] attachment_update completed successfully. Sep 25 11:51:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-d87b1ea1-ad74-40f9-9f9f-f95810719129 req-27718a1e-1b2f-417e-86da-0eb317e216eb tempest-TestStampPattern-1881844105 None] Terminate volume connection completed successfully. Sep 25 11:51:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-d87b1ea1-ad74-40f9-9f9f-f95810719129 req-27718a1e-1b2f-417e-86da-0eb317e216eb tempest-TestStampPattern-1881844105 None] Deleting attachment 484f6bf9-2cb7-44f9-8e74-3247699c18b9. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:51:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Lock "cinder-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-quobyte-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:07 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea77d362-f813-4f04-963a-d8ea1e97c246]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:08 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 Sep 25 11:51:08 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:08 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" returned: 0 in 0.497s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:08 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7 Sep 25 11:51:08 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:08 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" returned: 0 in 0.283s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7" released by "delete_volume" :: held 0.842s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:08 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Created reservations ['1da240f5-4c43-4b9c-ac4d-f6687319d6a9', 'b90f44a5-f8ce-4458-9811-1b9c340d62aa', 'eb3e3c8b-af5e-40f0-b428-40ed68370465', 'f2990e29-d239-4e18-921a-f7b2e940bdba'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:09 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:51:09 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:09 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.330s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:09 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Deleted volume successfully. Sep 25 11:51:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32dd2a6f-231e-4ff4-984f-343ed97943d4 tempest-TestStampPattern-1881844105 None] Lock "cinder-2b0ce6d4-8dd1-4cf7-aea8-7ebc777652a7-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Flow 'volume_create_manager' (b6814dc9-3382-4f44-aed6-5c9a1e934b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b8c664-3316-415e-941c-a6dafbc21550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b8c664-3316-415e-941c-a6dafbc21550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1045227798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25365df-5331-4e6f-b339-03bdb98fa830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c66c693511a495c998b31309c2a6722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:10Z,use_quota=True,user_id='6a4a8655233d407eaf1ac60123b088c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef7dad2-8831-4f8f-b1e1-574049b2e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef7dad2-8831-4f8f-b1e1-574049b2e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d44e7c8-7943-4b22-a021-a922857d2a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d44e7c8-7943-4b22-a021-a922857d2a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25365df-5331-4e6f-b339-03bdb98fa830', 'volume_name': 'volume-b25365df-5331-4e6f-b339-03bdb98fa830', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e164abf-5e2d-4a45-bc74-e8cb359a509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e164abf-5e2d-4a45-bc74-e8cb359a509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1024f27-2a0d-455d-b685-ca0f6b9d8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:10 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Volume b25365df-5331-4e6f-b339-03bdb98fa830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25365df-5331-4e6f-b339-03bdb98fa830', 'volume_size': 1} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1045227798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25365df-5331-4e6f-b339-03bdb98fa830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c66c693511a495c998b31309c2a6722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:10Z,use_quota=True,user_id='6a4a8655233d407eaf1ac60123b088c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Creating volume b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:10 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-11032781-487c-4304-ac39-20401fedd87f-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:10 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 1073741824 Sep 25 11:51:10 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Lock "cinder-11032781-487c-4304-ac39-20401fedd87f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-quobyte-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-quobyte-11032781-487c-4304-ac39-20401fedd87f" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-11032781-487c-4304-ac39-20401fedd87f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Deleting offline snapshot 11032781-487c-4304-ac39-20401fedd87f of volume ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] snapshot_file for this snap is: volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ac1f70-781a-4c19-a9d3-c9cecab83fb2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:10 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f Sep 25 11:51:10 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:11 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 1073741824" returned: 0 in 0.577s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:11 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 Sep 25 11:51:11 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:11 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f" returned: 0 in 0.523s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c9d6e-7aad-4837-94a1-91ad8c8e29ea]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:11 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 Sep 25 11:51:11 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:11 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830" returned: 0 in 0.286s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1024f27-2a0d-455d-b685-ca0f6b9d8619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25365df-5331-4e6f-b339-03bdb98fa830', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f826d8d6-fb03-4494-950f-5a04c882b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:11 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Volume volume-b25365df-5331-4e6f-b339-03bdb98fa830 (b25365df-5331-4e6f-b339-03bdb98fa830): created successfully Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f826d8d6-fb03-4494-950f-5a04c882b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Flow 'volume_create_manager' (b6814dc9-3382-4f44-aed6-5c9a1e934b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-021690f0-cfc2-438d-bca2-03d2a180bca2 tempest-VolumeDependencyTests-112707600 None] Created volume successfully. Sep 25 11:51:11 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" returned: 0 in 0.564s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:11 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f Sep 25 11:51:11 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:12 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:12 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f Sep 25 11:51:12 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:12 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83.11032781-487c-4304-ac39-20401fedd87f" returned: 0 in 0.269s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-11032781-487c-4304-ac39-20401fedd87f" released by "_delete_snapshot" :: held 1.868s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" released by "delete_snapshot" :: held 1.908s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Created reservations ['431ee003-8750-4a5b-9ae9-00ad99d9f0b1', '6f5811df-8888-44d6-9455-923b351989c6', '1e44ad6b-81ee-474e-a67e-42a15350896f', 'af17ce1d-5523-47f4-a610-a19ba8e44816'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:12 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Delete snapshot completed successfully. Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-04990463-f91e-44ef-8c23-9e37afe1777a tempest-TestStampPattern-1881844105 None] Lock "cinder-11032781-487c-4304-ac39-20401fedd87f-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Creating offline snapshot 2a2831e6-243a-406c-b3fa-576fb4bdbcf2 of volume b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4a135d-1413-4ec4-832a-06bd05fd24b9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:12 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 Sep 25 11:51:12 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:13 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830" returned: 0 in 0.394s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:13 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 1G Sep 25 11:51:13 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:13 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 1G" returned: 0 in 0.449s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25365df-5331-4e6f-b339-03bdb98fa830 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:13 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25365df-5331-4e6f-b339-03bdb98fa830 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 Sep 25 11:51:13 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:14 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25365df-5331-4e6f-b339-03bdb98fa830 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2" returned: 0 in 0.426s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:14 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 is being set with open permissions: ugo+rw Sep 25 11:51:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:14 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 Sep 25 11:51:14 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:14 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2" returned: 0 in 0.275s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:14 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.info Sep 25 11:51:14 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:14 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.info" returned: 0 in 0.347s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:14 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.info is being set with open permissions: ugo+rw Sep 25 11:51:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:14 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.info Sep 25 11:51:14 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:15 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.info" returned: 0 in 0.432s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-842c3290-3b44-47ef-9a7e-80d869b94593 tempest-VolumeDependencyTests-112707600 None] Create snapshot completed successfully Sep 25 11:51:16 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Flow 'volume_create_manager' (6a16e0c6-dc5a-4984-960c-858f8173bced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceba1b5e-7db0-44c2-a66b-9d28f86fd4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:16 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceba1b5e-7db0-44c2-a66b-9d28f86fd4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1777602224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf72cad4-12da-460b-b74f-26e5c76c3238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c66c693511a495c998b31309c2a6722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2a2831e6-243a-406c-b3fa-576fb4bdbcf2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:17Z,use_quota=True,user_id='6a4a8655233d407eaf1ac60123b088c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd08f9e-31cf-4454-a091-b3f8712c7f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd08f9e-31cf-4454-a091-b3f8712c7f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467f795e-30f4-466b-9824-af90c107b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467f795e-30f4-466b-9824-af90c107b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf72cad4-12da-460b-b74f-26e5c76c3238', 'volume_name': 'volume-cf72cad4-12da-460b-b74f-26e5c76c3238', 'volume_size': 1, 'snapshot_id': '2a2831e6-243a-406c-b3fa-576fb4bdbcf2'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af2d6ca-da44-4752-a577-bba3d02ba65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af2d6ca-da44-4752-a577-bba3d02ba65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45aa44a5-cfae-43a3-8fed-bed61d06ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:17 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Volume cf72cad4-12da-460b-b74f-26e5c76c3238: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf72cad4-12da-460b-b74f-26e5c76c3238', 'volume_size': 1, 'snapshot_id': '2a2831e6-243a-406c-b3fa-576fb4bdbcf2'} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-quobyte-2a2831e6-243a-406c-b3fa-576fb4bdbcf2-cf72cad4-12da-460b-b74f-26e5c76c3238" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-2a2831e6-243a-406c-b3fa-576fb4bdbcf2-cf72cad4-12da-460b-b74f-26e5c76c3238" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Creating volume cf72cad4-12da-460b-b74f-26e5c76c3238 from snapshot 2a2831e6-243a-406c-b3fa-576fb4bdbcf2 {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-quobyte-cf72cad4-12da-460b-b74f-26e5c76c3238" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-cf72cad4-12da-460b-b74f-26e5c76c3238" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] snapshot: 2a2831e6-243a-406c-b3fa-576fb4bdbcf2, volume: cf72cad4-12da-460b-b74f-26e5c76c3238, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b481fcb-83e7-439d-9811-166f9fdf66d8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:17 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 Sep 25 11:51:17 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:17 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2" returned: 0 in 0.575s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25365df-5331-4e6f-b339-03bdb98fa830(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2741e7d3-7c23-472d-809e-cc387566c6f2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:18 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 Sep 25 11:51:18 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Lock "cinder-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Acquiring lock "cinder-quobyte-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ef37d-bf1b-4610-8116-21abfbab5339]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:18 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830" returned: 0 in 0.556s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:18 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 Sep 25 11:51:18 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:18 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 Sep 25 11:51:18 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:18 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" returned: 0 in 0.453s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:18 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83 Sep 25 11:51:18 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:19 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" returned: 0 in 0.394s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Lock "cinder-quobyte-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83" released by "delete_volume" :: held 0.978s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Created reservations ['066a5c16-752b-4281-b37a-cf2903c87b04', '74e1ceb4-3fa8-4a5d-9fb8-d70185d813e8', 'b5429b1b-cfdd-4530-93b9-bde401edcc77', 'e049b9f0-bd4c-4e14-81d1-991cd6da3f9b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:19 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:51:19 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:20 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.494s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:20 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:20 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Deleted volume successfully. Sep 25 11:51:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f0e00607-31f9-4373-8288-4a350079ac2d tempest-TestStampPattern-1881844105 None] Lock "cinder-ca31e8f4-6c18-45e0-93e2-5501fd8dfc83-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:51:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:23 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:51:23 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:24 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.809s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:24 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:24 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:51:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:51:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:51:28 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238" returned: 0 in 9.974s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830, size 1024.00 MB, duration 9.98 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:51:28 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Converted 1024.00 MB image at 102.64 MB/s Sep 25 11:51:28 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 is being set with open permissions: ugo+rw Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:28 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 Sep 25 11:51:28 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:28 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238" returned: 0 in 0.343s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-cf72cad4-12da-460b-b74f-26e5c76c3238" released by "_copy_volume_from_snapshot" :: held 11.601s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-2a2831e6-243a-406c-b3fa-576fb4bdbcf2-cf72cad4-12da-460b-b74f-26e5c76c3238" released by "_create_volume_from_snapshot" :: held 11.756s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.776s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45aa44a5-cfae-43a3-8fed-bed61d06ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf72cad4-12da-460b-b74f-26e5c76c3238', 'volume_size': 1, 'snapshot_id': '2a2831e6-243a-406c-b3fa-576fb4bdbcf2'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddfd6c3-9e62-4ff6-a4bc-e1671a5302dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:28 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Volume volume-cf72cad4-12da-460b-b74f-26e5c76c3238 (cf72cad4-12da-460b-b74f-26e5c76c3238): created successfully Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddfd6c3-9e62-4ff6-a4bc-e1671a5302dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Flow 'volume_create_manager' (6a16e0c6-dc5a-4984-960c-858f8173bced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:28 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-bc660487-7736-42c0-ad2e-fbaa78d9bedf tempest-VolumeDependencyTests-112707600 None] Created volume successfully. Sep 25 11:51:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-2a2831e6-243a-406c-b3fa-576fb4bdbcf2-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Lock "cinder-2a2831e6-243a-406c-b3fa-576fb4bdbcf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-quobyte-b25365df-5331-4e6f-b339-03bdb98fa830" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-b25365df-5331-4e6f-b339-03bdb98fa830" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-quobyte-2a2831e6-243a-406c-b3fa-576fb4bdbcf2" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-2a2831e6-243a-406c-b3fa-576fb4bdbcf2" acquired by "_delete_snapshot" :: waited 0.091s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Deleting offline snapshot 2a2831e6-243a-406c-b3fa-576fb4bdbcf2 of volume b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:51:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] snapshot_file for this snap is: volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:51:30 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[facdd74d-255d-4307-b4f2-e13931153f44]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:30 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 Sep 25 11:51:30 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:30 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2" returned: 0 in 0.619s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25365df-5331-4e6f-b339-03bdb98fa830(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:30 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d29e90b-fc49-43d4-a8c9-d7f57f4b5e60]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:30 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 Sep 25 11:51:30 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:31 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830" returned: 0 in 0.856s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:31 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 Sep 25 11:51:31 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:31 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2" returned: 0 in 0.417s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:32 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2 Sep 25 11:51:32 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:32 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830.2a2831e6-243a-406c-b3fa-576fb4bdbcf2" returned: 0 in 0.313s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-2a2831e6-243a-406c-b3fa-576fb4bdbcf2" released by "_delete_snapshot" :: held 2.511s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-b25365df-5331-4e6f-b339-03bdb98fa830" released by "delete_snapshot" :: held 2.611s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:32 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Created reservations ['1afb928b-3f5d-4d06-99e0-779b8ab7d753', 'd9a77a4a-5986-4544-a447-4afaec4debf5', 'df7d2586-7cff-42c9-93f6-33ded96878d0', '53677789-aa9f-428c-8f20-14cf1cb683fd'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:32 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Delete snapshot completed successfully. Sep 25 11:51:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-541b9cdc-b333-4aeb-941e-b17dfdea5d3c tempest-VolumeDependencyTests-112707600 None] Lock "cinder-2a2831e6-243a-406c-b3fa-576fb4bdbcf2-delete_snapshot" released by "delete_snapshot" :: held 2.865s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-b25365df-5331-4e6f-b339-03bdb98fa830-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Lock "cinder-b25365df-5331-4e6f-b339-03bdb98fa830-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-quobyte-b25365df-5331-4e6f-b339-03bdb98fa830" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-b25365df-5331-4e6f-b339-03bdb98fa830" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[647f03a1-ab2d-41b7-b69c-de022e3ba7d0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:33 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 Sep 25 11:51:33 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:33 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830" returned: 0 in 0.528s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:33 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830 Sep 25 11:51:33 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:34 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-b25365df-5331-4e6f-b339-03bdb98fa830" returned: 0 in 0.302s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-b25365df-5331-4e6f-b339-03bdb98fa830" released by "delete_volume" :: held 0.921s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Created reservations ['4025f9ec-680f-4132-8365-f1cb3943fa1c', '0f16dbec-af5a-4ded-8ee9-0e3bff41af74', '0bcddf5b-826d-4af1-8ac0-f0443b1856c9', 'c7aeb04b-e42a-42b2-950c-401d13b87ed1'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:34 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:51:34 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-cf72cad4-12da-460b-b74f-26e5c76c3238-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Lock "cinder-cf72cad4-12da-460b-b74f-26e5c76c3238-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Acquiring lock "cinder-quobyte-cf72cad4-12da-460b-b74f-26e5c76c3238" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-cf72cad4-12da-460b-b74f-26e5c76c3238" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ac2e61-6162-415f-8ba4-72bafed3fa01]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:34 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.438s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Deleted volume successfully. Sep 25 11:51:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2664e689-214e-47ac-8f8f-7c94bab8d45d tempest-VolumeDependencyTests-112707600 None] Lock "cinder-b25365df-5331-4e6f-b339-03bdb98fa830-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:34 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 Sep 25 11:51:34 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:35 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238" returned: 0 in 0.670s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:35 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238 Sep 25 11:51:35 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:35 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cf72cad4-12da-460b-b74f-26e5c76c3238" returned: 0 in 0.305s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Lock "cinder-quobyte-cf72cad4-12da-460b-b74f-26e5c76c3238" released by "delete_volume" :: held 1.042s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Created reservations ['e9269fa8-0498-453b-8e08-440df5596243', '53025a51-7bec-4dd4-b818-ffd86047f936', 'e7481140-a0a4-4a90-b75a-7a708059d9d0', 'db2d6836-e220-4d0c-8032-d3b08dd8344d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:35 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:51:35 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:36 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.289s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:36 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Deleted volume successfully. Sep 25 11:51:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f03bdd13-eca1-4653-bd87-582da6ef6d3d tempest-VolumeDependencyTests-112707600 None] Lock "cinder-cf72cad4-12da-460b-b74f-26e5c76c3238-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=64,cinder:SELECT=70,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=59,cinder:UPDATE=73,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Flow 'volume_create_manager' (d4e539bf-c769-4a48-a0e1-fdb037539477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71267300-b1bc-49a5-84ab-dd804a38e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71267300-b1bc-49a5-84ab-dd804a38e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392467745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b03747f-9055-428b-ad53-2a36d4719c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5604322a9847418a7e91055a0de64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:42Z,use_quota=True,user_id='12ed21733bec4ca0a585a814422dcf10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c07ad6-ec3d-4127-a5d6-98a3f6a1f300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c07ad6-ec3d-4127-a5d6-98a3f6a1f300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c878df3f-ee6a-4d2a-a5c5-3c1d069eb33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c878df3f-ee6a-4d2a-a5c5-3c1d069eb33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b03747f-9055-428b-ad53-2a36d4719c9f', 'volume_name': 'volume-5b03747f-9055-428b-ad53-2a36d4719c9f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567cb628-f5ed-4189-a050-e8d961297206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567cb628-f5ed-4189-a050-e8d961297206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361d3502-2cc2-4f56-8e12-7e766e2e5b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Volume 5b03747f-9055-428b-ad53-2a36d4719c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b03747f-9055-428b-ad53-2a36d4719c9f', 'volume_size': 1} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392467745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b03747f-9055-428b-ad53-2a36d4719c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5604322a9847418a7e91055a0de64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:42Z,use_quota=True,user_id='12ed21733bec4ca0a585a814422dcf10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Creating volume 5b03747f-9055-428b-ad53-2a36d4719c9f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:42 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:51:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:42 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f 1073741824 Sep 25 11:51:42 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:43 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f 1073741824" returned: 0 in 0.625s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:43 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f Sep 25 11:51:43 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:43 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f" returned: 0 in 0.329s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361d3502-2cc2-4f56-8e12-7e766e2e5b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b03747f-9055-428b-ad53-2a36d4719c9f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930b3a1c-8618-4ea4-bbb2-43fecf280fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:43 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Volume volume-5b03747f-9055-428b-ad53-2a36d4719c9f (5b03747f-9055-428b-ad53-2a36d4719c9f): created successfully Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930b3a1c-8618-4ea4-bbb2-43fecf280fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Flow 'volume_create_manager' (d4e539bf-c769-4a48-a0e1-fdb037539477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:43 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-225fa7c2-8328-4800-9f1d-04d9889f9628 tempest-ProjectReaderTests-1259950021 None] Created volume successfully. Sep 25 11:51:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "cinder-5b03747f-9055-428b-ad53-2a36d4719c9f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Lock "cinder-5b03747f-9055-428b-ad53-2a36d4719c9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "cinder-quobyte-5b03747f-9055-428b-ad53-2a36d4719c9f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Lock "cinder-quobyte-5b03747f-9055-428b-ad53-2a36d4719c9f" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:44 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c577da9c-af21-499d-b1a3-3c8d1c3623f2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:44 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f Sep 25 11:51:44 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:45 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f" returned: 0 in 0.474s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:45 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f Sep 25 11:51:45 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:45 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5b03747f-9055-428b-ad53-2a36d4719c9f" returned: 0 in 0.282s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Lock "cinder-quobyte-5b03747f-9055-428b-ad53-2a36d4719c9f" released by "delete_volume" :: held 0.819s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Created reservations ['d137f0cd-5ebc-4aab-ae92-2bfc0a55c271', 'd0c8f089-1ec8-40a3-a520-17524e50c8a2', 'b609f11d-69fb-464d-89e4-fabfda259023', '46598425-6efb-41b4-9372-76e3931feb86'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:45 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:51:45 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:46 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.359s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:46 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Deleted volume successfully. Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ebb74c31-7fd3-44fb-a3b2-d73aeef0e172 tempest-ProjectReaderTests-1259950021 None] Lock "cinder-5b03747f-9055-428b-ad53-2a36d4719c9f-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Flow 'volume_create_manager' (07e402cf-ca48-4c51-bade-dc8080d5c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87da36bb-6670-4408-8f01-33cdcd967c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87da36bb-6670-4408-8f01-33cdcd967c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-590331030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c354a67-4a9e-4e20-9273-e62ee9ffecd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5604322a9847418a7e91055a0de64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:47Z,use_quota=True,user_id='12ed21733bec4ca0a585a814422dcf10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5978b82-8505-477b-963f-d82cd584da72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5978b82-8505-477b-963f-d82cd584da72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e602166-d45e-4dc8-b745-c44c0db7717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e602166-d45e-4dc8-b745-c44c0db7717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c354a67-4a9e-4e20-9273-e62ee9ffecd9', 'volume_name': 'volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940086d9-a923-4f04-a578-4e59e433832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940086d9-a923-4f04-a578-4e59e433832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a9ca50-68d6-4fc7-a8aa-4c77de12a4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Volume 0c354a67-4a9e-4e20-9273-e62ee9ffecd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9', 'volume_size': 1} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-590331030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c354a67-4a9e-4e20-9273-e62ee9ffecd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5604322a9847418a7e91055a0de64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:47Z,use_quota=True,user_id='12ed21733bec4ca0a585a814422dcf10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Creating volume 0c354a67-4a9e-4e20-9273-e62ee9ffecd9 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:46 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:46 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 1073741824 Sep 25 11:51:46 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Flow 'volume_create_manager' (4a3ee31a-8039-44b3-87f3-7c59ecdcad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81905be1-7886-4d33-abc5-82122537e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81905be1-7886-4d33-abc5-82122537e1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b1c0bf3be2471799ad0b21fd85d833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:47Z,use_quota=True,user_id='d06e425ba3b14d0c83671ab0664f5734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1e198f4-8255-4b2d-9c34-bbba386a8215),volume_type_id=d1e198f4-8255-4b2d-9c34-bbba386a8215)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f73d746-21a8-480e-8900-00eb652fd6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f73d746-21a8-480e-8900-00eb652fd6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddfdf81-db9b-4863-8a68-f8372e492810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddfdf81-db9b-4863-8a68-f8372e492810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e', 'volume_name': 'volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e', 'volume_size': 1, 'image_id': 'f7780edd-5016-408e-b235-466105805b64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7780edd-5016-408e-b235-466105805b64', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec98a4ca4b0e4a150011f8fe905bdf8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00b1c0bf3be2471799ad0b21fd85d833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '27f41b2f78559b8c758d8e9724cfd3e91819001865642e8d1591630fd5fc0005e600170265c205e6834f6bcff136b75948dd52815a7b35da0946fc0beaf3d2c9', 'id': 'f7780edd-5016-408e-b235-466105805b64', 'created_at': datetime.datetime(2026, 9, 25, 9, 51, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 51, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7780edd-5016-408e-b235-466105805b64/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e4afc1-e748-407a-9eb3-10869d8be45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e4afc1-e748-407a-9eb3-10869d8be45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:47 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846ed66e-a622-43e8-abf7-cd42c0cffe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:47 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Volume 14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e', 'volume_size': 1, 'image_id': 'f7780edd-5016-408e-b235-466105805b64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7780edd-5016-408e-b235-466105805b64', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec98a4ca4b0e4a150011f8fe905bdf8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00b1c0bf3be2471799ad0b21fd85d833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '27f41b2f78559b8c758d8e9724cfd3e91819001865642e8d1591630fd5fc0005e600170265c205e6834f6bcff136b75948dd52815a7b35da0946fc0beaf3d2c9', 'id': 'f7780edd-5016-408e-b235-466105805b64', 'created_at': datetime.datetime(2026, 9, 25, 9, 51, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 51, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7780edd-5016-408e-b235-466105805b64/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Trying to clone 14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e from image f7780edd-5016-408e-b235-466105805b64 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7780edd-5016-408e-b235-466105805b64', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 1073741824" returned: 0 in 0.652s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:47 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 Sep 25 11:51:47 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:51:47 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Image download 0.00 MB at 0.00 MB/s Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[402f1737-b5b1-4461-b20f-e723e9a5f039]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:47 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD Sep 25 11:51:47 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:47 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9" returned: 0 in 0.339s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a9ca50-68d6-4fc7-a8aa-4c77de12a4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce74f382-1a22-4705-a8d0-517c92f8e646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:47 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Volume volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 (0c354a67-4a9e-4e20-9273-e62ee9ffecd9): created successfully Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce74f382-1a22-4705-a8d0-517c92f8e646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Flow 'volume_create_manager' (07e402cf-ca48-4c51-bade-dc8080d5c311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4da508e3-a1f3-4cf5-8e70-3cd23a467706 tempest-ProjectReaderTests-1259950021 None] Created volume successfully. Sep 25 11:51:47 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:48 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD Sep 25 11:51:48 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:48 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Temporary image f7780edd-5016-408e-b235-466105805b64 is fetched for user d06e425ba3b14d0c83671ab0664f5734. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[35532b62-9d55-4dbf-aa8f-429fe22e77cb]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:48 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD Sep 25 11:51:48 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:48 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "cinder-0c354a67-4a9e-4e20-9273-e62ee9ffecd9-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:48 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD Sep 25 11:51:48 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Lock "cinder-0c354a67-4a9e-4e20-9273-e62ee9ffecd9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "cinder-quobyte-0c354a67-4a9e-4e20-9273-e62ee9ffecd9" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Lock "cinder-quobyte-0c354a67-4a9e-4e20-9273-e62ee9ffecd9" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed17e951-73cc-4466-bf94-58c1bf1055ce]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:49 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 Sep 25 11:51:49 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:49 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD" returned: 1 in 0.469s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b1c0bf3be2471799ad0b21fd85d833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:47Z,use_quota=True,user_id='d06e425ba3b14d0c83671ab0664f5734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1e198f4-8255-4b2d-9c34-bbba386a8215),volume_type_id=d1e198f4-8255-4b2d-9c34-bbba386a8215)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Creating volume 14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:49 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:49 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e 1073741824 Sep 25 11:51:49 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:49 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9" returned: 0 in 0.512s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:49 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9 Sep 25 11:51:49 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:49 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e 1073741824" returned: 0 in 0.615s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:49 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c354a67-4a9e-4e20-9273-e62ee9ffecd9" returned: 0 in 0.350s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Lock "cinder-quobyte-0c354a67-4a9e-4e20-9273-e62ee9ffecd9" released by "delete_volume" :: held 0.969s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:49 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e Sep 25 11:51:49 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:49 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Created reservations ['a7504966-ade8-49e0-96e2-78d8e914b1d2', 'b9bda0b0-b0ca-47c6-b115-b0d4fd9414de', '69c53bcc-512e-4c75-aeb7-4cfab5299e64', '626f3cb2-016c-4f8e-b6a4-7c395cc884cc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:50 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:51:50 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:50 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e" returned: 0 in 0.425s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Attempting download of f7780edd-5016-408e-b235-466105805b64 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7780edd-5016-408e-b235-466105805b64', 'metadata': {}}])) to volume 14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2892cb-80ca-4d75-aa06-173d33c58e8f]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7780edd-5016-408e-b235-466105805b64_u0p9x4ns {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:50 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.353s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Deleted volume successfully. Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-37fa54aa-a3e0-4352-a3c3-5c5d32a21058 tempest-ProjectReaderTests-1259950021 None] Lock "cinder-0c354a67-4a9e-4e20-9273-e62ee9ffecd9-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:50 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7780edd-5016-408e-b235-466105805b64_u0p9x4ns Sep 25 11:51:50 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:50 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7780edd-5016-408e-b235-466105805b64_u0p9x4ns" returned: 0 in 0.403s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7780edd-5016-408e-b235-466105805b64_u0p9x4ns {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:50 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7780edd-5016-408e-b235-466105805b64_u0p9x4ns Sep 25 11:51:50 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:51 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7780edd-5016-408e-b235-466105805b64_u0p9x4ns" returned: 1 in 0.367s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7780edd-5016-408e-b235-466105805b64_u0p9x4ns' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fade2bb6-1448-4a80-8d84-8625d3b6ab12]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:51 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD Sep 25 11:51:51 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:51 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:51 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD Sep 25 11:51:51 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:51 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] f7780edd-5016-408e-b235-466105805b64 was raw, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:51:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:51 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e Sep 25 11:51:51 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:52 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e" returned: 0 in 0.636s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:52 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7780edd-5016-408e-b235-466105805b64_q40d9td5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:51:52 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 11:51:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:52 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e 1G Sep 25 11:51:52 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:53 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e 1G" returned: 0 in 0.427s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Downloaded image f7780edd-5016-408e-b235-466105805b64 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7780edd-5016-408e-b235-466105805b64', 'metadata': {}}])) to volume 14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Temporary image f7780edd-5016-408e-b235-466105805b64 for user d06e425ba3b14d0c83671ab0664f5734 is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Marking volume 14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Copying metadata from image f7780edd-5016-408e-b235-466105805b64 to 14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Creating volume glance metadata for volume 14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e backed by image f7780edd-5016-408e-b235-466105805b64 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f7780edd-5016-408e-b235-466105805b64', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ec98a4ca4b0e4a150011f8fe905bdf8c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846ed66e-a622-43e8-abf7-cd42c0cffe8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e', 'volume_size': 1, 'image_id': 'f7780edd-5016-408e-b235-466105805b64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7780edd-5016-408e-b235-466105805b64', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec98a4ca4b0e4a150011f8fe905bdf8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00b1c0bf3be2471799ad0b21fd85d833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '27f41b2f78559b8c758d8e9724cfd3e91819001865642e8d1591630fd5fc0005e600170265c205e6834f6bcff136b75948dd52815a7b35da0946fc0beaf3d2c9', 'id': 'f7780edd-5016-408e-b235-466105805b64', 'created_at': datetime.datetime(2026, 9, 25, 9, 51, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 51, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7780edd-5016-408e-b235-466105805b64/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac978bc4-4b76-4c64-bd49-a4a5bb189e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:53 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Volume volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e (14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e): created successfully Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac978bc4-4b76-4c64-bd49-a4a5bb189e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Flow 'volume_create_manager' (4a3ee31a-8039-44b3-87f3-7c59ecdcad31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-912ff849-3eca-4d06-88a0-c3214fd1a1be tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Created volume successfully. Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Acquiring lock "cinder-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "cinder-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Acquiring lock "cinder-quobyte-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "cinder-quobyte-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[273c6a62-8c15-4161-9c6a-3326313f24e3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:53 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e Sep 25 11:51:53 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:54 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e" returned: 0 in 0.462s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:54 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e Sep 25 11:51:54 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:54 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e" returned: 0 in 0.283s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "cinder-quobyte-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e" released by "delete_volume" :: held 0.804s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:54 devstack cinder-volume[87356]: WARNING cinder.quota [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:51:54 devstack cinder-volume[87356]: WARNING cinder.quota [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Created reservations ['cd59dfc7-3777-4ccb-a121-0d68cd019595', '69ea615c-4589-4717-b879-7e1e890f4a65', '554bb70d-4060-44e7-8110-fa0488e6584a', '28797aac-3b0a-409b-8808-a5a0c3743d1b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:54 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:51:54 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:54 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.281s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:54 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Deleted volume successfully. Sep 25 11:51:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4c4830dc-5233-46cb-9e30-b33d7c8253ff tempest-VolumeAndVolumeTypeFromImageTest-1355937598 None] Lock "cinder-14eda7b3-62d9-4ff1-9820-1b41ee5a0e2e-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Flow 'volume_create_manager' (bc3a7b7b-840e-4081-9ac9-7b4f75789ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8265c220-857a-44a0-9893-f47323377577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8265c220-857a-44a0-9893-f47323377577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763653865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=899f344e-d44b-4121-b053-b0bc3ba5026c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653ecb57913e4b94a18a32189c81c586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:01Z,use_quota=True,user_id='c16ad24dde244be3b19c78b2b5528909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87eb7988-0f45-49e1-b898-ae20fed7d69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87eb7988-0f45-49e1-b898-ae20fed7d69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfbe6ff-cb90-415f-85af-1769f4003ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfbe6ff-cb90-415f-85af-1769f4003ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '899f344e-d44b-4121-b053-b0bc3ba5026c', 'volume_name': 'volume-899f344e-d44b-4121-b053-b0bc3ba5026c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0450724-33e1-4bda-ad3b-c10ee61b1b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0450724-33e1-4bda-ad3b-c10ee61b1b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcdf898-0106-4339-8aad-0cceb9de771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Volume 899f344e-d44b-4121-b053-b0bc3ba5026c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-899f344e-d44b-4121-b053-b0bc3ba5026c', 'volume_size': 1} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763653865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=899f344e-d44b-4121-b053-b0bc3ba5026c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653ecb57913e4b94a18a32189c81c586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:01Z,use_quota=True,user_id='c16ad24dde244be3b19c78b2b5528909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Creating volume 899f344e-d44b-4121-b053-b0bc3ba5026c {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:01 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:01 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c 1073741824 Sep 25 11:52:01 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:01 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c 1073741824" returned: 0 in 0.630s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:01 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c Sep 25 11:52:01 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:02 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c" returned: 0 in 0.316s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcdf898-0106-4339-8aad-0cceb9de771e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-899f344e-d44b-4121-b053-b0bc3ba5026c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5c0f15-9612-425e-b262-7fc324faf8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:02 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Volume volume-899f344e-d44b-4121-b053-b0bc3ba5026c (899f344e-d44b-4121-b053-b0bc3ba5026c): created successfully Sep 25 11:52:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5c0f15-9612-425e-b262-7fc324faf8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Flow 'volume_create_manager' (bc3a7b7b-840e-4081-9ac9-7b4f75789ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:02 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-dfbf06ff-dac4-40e6-947b-2143fd3a92e8 tempest-ProjectReaderTests-245949082 None] Created volume successfully. Sep 25 11:52:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Acquiring lock "cinder-899f344e-d44b-4121-b053-b0bc3ba5026c-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Lock "cinder-899f344e-d44b-4121-b053-b0bc3ba5026c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Acquiring lock "cinder-quobyte-899f344e-d44b-4121-b053-b0bc3ba5026c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Lock "cinder-quobyte-899f344e-d44b-4121-b053-b0bc3ba5026c" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:03 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c70784-b40d-40c7-b0e8-7dd0ffb254e9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:03 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c Sep 25 11:52:03 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:04 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c" returned: 0 in 0.566s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:04 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c Sep 25 11:52:04 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:04 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-899f344e-d44b-4121-b053-b0bc3ba5026c" returned: 0 in 0.331s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Lock "cinder-quobyte-899f344e-d44b-4121-b053-b0bc3ba5026c" released by "delete_volume" :: held 0.955s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Created reservations ['56c6c6e6-afac-40b7-be52-6e5921dba502', '92e63343-a5bb-4a5e-b021-6c1aabe39bf4', '58a843d2-48fe-495d-89ca-d94f4221ad54', '6055b5c6-f6ae-4e3e-9983-f7843e6e95ef'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:04 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:04 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:05 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.343s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:05 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Deleted volume successfully. Sep 25 11:52:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d4a76635-8ffe-49f0-89de-f5362a7507a2 tempest-ProjectReaderTests-245949082 None] Lock "cinder-899f344e-d44b-4121-b053-b0bc3ba5026c-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Flow 'volume_create_manager' (e08867e0-2ee9-4d2e-8ff1-b450fdcedaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167a8ffd-e1f8-4796-93ae-f34c13ff9992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167a8ffd-e1f8-4796-93ae-f34c13ff9992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125668420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479da619-4cbc-4fb3-b565-24a088d1f88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653ecb57913e4b94a18a32189c81c586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:06Z,use_quota=True,user_id='c16ad24dde244be3b19c78b2b5528909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a73a567-7d02-4f8b-8992-08eb5f884a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a73a567-7d02-4f8b-8992-08eb5f884a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb179c6e-5215-4f2f-b418-1484c512162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb179c6e-5215-4f2f-b418-1484c512162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479da619-4cbc-4fb3-b565-24a088d1f88f', 'volume_name': 'volume-479da619-4cbc-4fb3-b565-24a088d1f88f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3b27d6-cd43-4a02-8529-2ee5a06b311a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3b27d6-cd43-4a02-8529-2ee5a06b311a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1622f91b-dcd2-493f-bee8-2928c8233998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:06 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Volume 479da619-4cbc-4fb3-b565-24a088d1f88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479da619-4cbc-4fb3-b565-24a088d1f88f', 'volume_size': 1} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125668420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479da619-4cbc-4fb3-b565-24a088d1f88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653ecb57913e4b94a18a32189c81c586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:06Z,use_quota=True,user_id='c16ad24dde244be3b19c78b2b5528909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Creating volume 479da619-4cbc-4fb3-b565-24a088d1f88f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:06 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:06 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f 1073741824 Sep 25 11:52:06 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:07 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f 1073741824" returned: 0 in 0.738s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:07 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f Sep 25 11:52:07 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:07 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f" returned: 0 in 0.413s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1622f91b-dcd2-493f-bee8-2928c8233998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479da619-4cbc-4fb3-b565-24a088d1f88f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56683578-0058-4400-bbb7-decfaa27790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:07 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Volume volume-479da619-4cbc-4fb3-b565-24a088d1f88f (479da619-4cbc-4fb3-b565-24a088d1f88f): created successfully Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56683578-0058-4400-bbb7-decfaa27790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Flow 'volume_create_manager' (e08867e0-2ee9-4d2e-8ff1-b450fdcedaf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1021bc3b-ce98-45d2-8e97-59c0c812c631 tempest-ProjectReaderTests-245949082 None] Created volume successfully. Sep 25 11:52:08 devstack cinder-volume[87356]: INFO cinder.volume.manager [req-1e88b530-e66e-47d3-aecf-7aaacd39bb36 req-eba9b054-0531-46c5-b8ab-e28f3c787104 tempest-TestMinimumBasicScenario-103785383 None] Terminate volume connection completed successfully. Sep 25 11:52:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [req-1e88b530-e66e-47d3-aecf-7aaacd39bb36 req-eba9b054-0531-46c5-b8ab-e28f3c787104 tempest-TestMinimumBasicScenario-103785383 None] Deleting attachment e1195763-da56-4f4f-a4bb-fd32e0b315b1. {{(pid=87356) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:52:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Acquiring lock "cinder-479da619-4cbc-4fb3-b565-24a088d1f88f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Lock "cinder-479da619-4cbc-4fb3-b565-24a088d1f88f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Acquiring lock "cinder-quobyte-479da619-4cbc-4fb3-b565-24a088d1f88f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Lock "cinder-quobyte-479da619-4cbc-4fb3-b565-24a088d1f88f" acquired by "delete_volume" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:08 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6755e2-8e33-429c-8852-79b22893a433]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:09 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f Sep 25 11:52:09 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:09 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f" returned: 0 in 0.716s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:09 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f Sep 25 11:52:09 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Acquiring lock "cinder-5d7532e5-fc21-491a-aa38-92ae98419cf2-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Lock "cinder-5d7532e5-fc21-491a-aa38-92ae98419cf2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Acquiring lock "cinder-quobyte-5d7532e5-fc21-491a-aa38-92ae98419cf2" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Lock "cinder-quobyte-5d7532e5-fc21-491a-aa38-92ae98419cf2" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63b8114-0d2d-48e0-9b59-36d9318282e8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:10 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 Sep 25 11:52:10 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:10 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-479da619-4cbc-4fb3-b565-24a088d1f88f" returned: 0 in 0.477s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Lock "cinder-quobyte-479da619-4cbc-4fb3-b565-24a088d1f88f" released by "delete_volume" :: held 1.285s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Created reservations ['e1b6f4b9-f41b-49f6-88c5-f962384e3ed3', 'a874382f-2069-4aaa-b3e6-1306356a9e66', '2db82aa0-722a-4a11-a0bb-a743f2dd794e', 'f707aedf-91db-4b44-b160-69470396d4f5'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:10 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:10 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:10 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2" returned: 0 in 0.650s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:10 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2 Sep 25 11:52:10 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:10 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Deleted volume successfully. Sep 25 11:52:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-be8e7efc-44c1-4b2b-bd34-2ecf26b9a177 tempest-ProjectReaderTests-245949082 None] Lock "cinder-479da619-4cbc-4fb3-b565-24a088d1f88f-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:11 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5d7532e5-fc21-491a-aa38-92ae98419cf2" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Lock "cinder-quobyte-5d7532e5-fc21-491a-aa38-92ae98419cf2" released by "delete_volume" :: held 1.196s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Created reservations ['7d153193-347a-4e28-b5e0-77a2de739401', 'aeeb6663-4da1-45f3-8a8f-04de078aaba2', 'b41d3bc6-bf09-4039-82bc-c0bca09388db', 'db00f73d-7f3e-45c3-8f4f-7621b28ed4fe'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:11 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:11 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:11 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Flow 'volume_create_manager' (5dc347ef-3b78-4b8d-8690-4c5ea6772c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b953a1-9212-45f2-994e-31450093fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.561s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Deleted volume successfully. Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b953a1-9212-45f2-994e-31450093fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741075457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba05abb-59b3-4ed4-97e9-8a4fba395f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653ecb57913e4b94a18a32189c81c586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:12Z,use_quota=True,user_id='c16ad24dde244be3b19c78b2b5528909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37f4b89-1f1e-4f0b-90eb-317b995c80ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37f4b89-1f1e-4f0b-90eb-317b995c80ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cd1e3c-5f7e-4c45-b548-03c34e5395cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cd1e3c-5f7e-4c45-b548-03c34e5395cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba05abb-59b3-4ed4-97e9-8a4fba395f1d', 'volume_name': 'volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10af9632-7614-4f5a-affe-0ce1c8235546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10af9632-7614-4f5a-affe-0ce1c8235546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686ade5b-0fac-4802-9979-fd9be140214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:12 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Volume 4ba05abb-59b3-4ed4-97e9-8a4fba395f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d', 'volume_size': 1} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741075457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba05abb-59b3-4ed4-97e9-8a4fba395f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653ecb57913e4b94a18a32189c81c586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:12Z,use_quota=True,user_id='c16ad24dde244be3b19c78b2b5528909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Creating volume 4ba05abb-59b3-4ed4-97e9-8a4fba395f1d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:12 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64d85a59-69c0-4d9f-933e-dd5d8044bed5 tempest-TestMinimumBasicScenario-103785383 None] Lock "cinder-5d7532e5-fc21-491a-aa38-92ae98419cf2-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:12 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d 1073741824 Sep 25 11:52:12 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:12 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d 1073741824" returned: 0 in 0.838s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:12 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d Sep 25 11:52:12 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:13 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d" returned: 0 in 0.562s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686ade5b-0fac-4802-9979-fd9be140214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2f0b44-45dd-438f-a90e-e9ced4d7830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:13 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Volume volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d (4ba05abb-59b3-4ed4-97e9-8a4fba395f1d): created successfully Sep 25 11:52:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2f0b44-45dd-438f-a90e-e9ced4d7830c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Flow 'volume_create_manager' (5dc347ef-3b78-4b8d-8690-4c5ea6772c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-db13e42c-da91-4b40-b837-8062a91cbdc9 tempest-ProjectReaderTests-245949082 None] Created volume successfully. Sep 25 11:52:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Acquiring lock "cinder-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Lock "cinder-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Acquiring lock "cinder-quobyte-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Lock "cinder-quobyte-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d" acquired by "delete_volume" :: waited 0.047s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad9e49f-8dc4-4845-b10d-8dda59c9ac4e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:14 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d Sep 25 11:52:14 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:15 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d" returned: 0 in 0.876s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:15 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d Sep 25 11:52:15 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:15 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Lock "cinder-quobyte-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d" released by "delete_volume" :: held 1.445s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Created reservations ['c3fcf7c2-3938-462a-991b-9ac24d5bb5f1', '4f9b4f47-4d84-42ae-bad5-c60ee21be20c', '7febe20e-fc62-4df7-a4e3-1bef200afbc5', '301f09c9-ba24-4102-9c3e-00917d80ce2d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:16 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:16 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:16 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.443s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Deleted volume successfully. Sep 25 11:52:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6699209c-9581-44cd-9cc9-1fa1c957e0eb tempest-ProjectReaderTests-245949082 None] Lock "cinder-4ba05abb-59b3-4ed4-97e9-8a4fba395f1d-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Flow 'volume_create_manager' (690a35b9-fca8-49db-9483-e8fe792b0284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e02b54-e76f-4fb5-a860-3ccc81abc9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e02b54-e76f-4fb5-a860-3ccc81abc9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613100485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c541ccc-f58f-4a81-b5a9-714f56ce1d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653ecb57913e4b94a18a32189c81c586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:17Z,use_quota=True,user_id='c16ad24dde244be3b19c78b2b5528909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d993a1fc-232a-4144-bb39-6a83c058e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d993a1fc-232a-4144-bb39-6a83c058e145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa703aec-7253-4693-8163-29ba99e1ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa703aec-7253-4693-8163-29ba99e1ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c541ccc-f58f-4a81-b5a9-714f56ce1d97', 'volume_name': 'volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10974047-3490-4296-acef-fa4392aaaaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10974047-3490-4296-acef-fa4392aaaaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c6debb-c227-4681-a5c8-da30d2ef802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:17 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Volume 8c541ccc-f58f-4a81-b5a9-714f56ce1d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97', 'volume_size': 1} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613100485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c541ccc-f58f-4a81-b5a9-714f56ce1d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653ecb57913e4b94a18a32189c81c586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:17Z,use_quota=True,user_id='c16ad24dde244be3b19c78b2b5528909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Creating volume 8c541ccc-f58f-4a81-b5a9-714f56ce1d97 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:17 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:17 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 1073741824 Sep 25 11:52:17 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:18 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 1073741824" returned: 0 in 0.736s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:18 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 Sep 25 11:52:18 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:18 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97" returned: 0 in 0.367s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c6debb-c227-4681-a5c8-da30d2ef802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6d8645-711e-432a-87b1-b8f183b8423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:18 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Volume volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 (8c541ccc-f58f-4a81-b5a9-714f56ce1d97): created successfully Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6d8645-711e-432a-87b1-b8f183b8423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Flow 'volume_create_manager' (690a35b9-fca8-49db-9483-e8fe792b0284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:18 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-65ec5ae2-6132-45a4-be34-7c16e7d61f6b tempest-ProjectReaderTests-245949082 None] Created volume successfully. Sep 25 11:52:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Acquiring lock "cinder-8c541ccc-f58f-4a81-b5a9-714f56ce1d97-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Lock "cinder-8c541ccc-f58f-4a81-b5a9-714f56ce1d97-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Acquiring lock "cinder-quobyte-8c541ccc-f58f-4a81-b5a9-714f56ce1d97" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Lock "cinder-quobyte-8c541ccc-f58f-4a81-b5a9-714f56ce1d97" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:19 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74e8210-040a-4f6c-a9fb-3e16c15c2d4a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:20 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 Sep 25 11:52:20 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:20 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97" returned: 0 in 0.606s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:20 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97 Sep 25 11:52:20 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:20 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c541ccc-f58f-4a81-b5a9-714f56ce1d97" returned: 0 in 0.418s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Lock "cinder-quobyte-8c541ccc-f58f-4a81-b5a9-714f56ce1d97" released by "delete_volume" :: held 1.101s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Created reservations ['3d750354-ce8d-45f1-bbf1-ce413f46feb4', '05ff3735-1d69-464d-86c8-b1f8fc9fa728', '1248fc0d-89e7-45f3-b28c-90852e5c8c77', '547f4d1b-cc55-45f5-8b83-4d09b27b8844'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:21 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:21 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:21 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.347s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:21 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Deleted volume successfully. Sep 25 11:52:21 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44b07f8b-d3db-4261-89f4-057191164d13 tempest-ProjectReaderTests-245949082 None] Lock "cinder-8c541ccc-f58f-4a81-b5a9-714f56ce1d97-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:23 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:23 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:23 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.416s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:52:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=53,cinder:UPDATE=91,cinder:DELETE=9,cinder:INSERT=25 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Flow 'volume_create_manager' (fbae3d05-f7fa-4661-ba08-b7dfe6066f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75ee93e-22e5-4af2-8409-a9bc66ffb1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75ee93e-22e5-4af2-8409-a9bc66ffb1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-987950901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f90781e-85ad-4789-b8a3-737cfbd809e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7698ec7e42c47afbfd5509f18c6b13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:31Z,use_quota=True,user_id='2fe184822a254d3a87b99c8ce13b5156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a241551c-a747-4be5-b695-cdcdf2b6d473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a241551c-a747-4be5-b695-cdcdf2b6d473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce4ba7f-26a4-4be4-a1fd-0c04b6c82bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce4ba7f-26a4-4be4-a1fd-0c04b6c82bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f90781e-85ad-4789-b8a3-737cfbd809e2', 'volume_name': 'volume-8f90781e-85ad-4789-b8a3-737cfbd809e2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81a89f3-bdaf-48c0-ad10-f3f71281adf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81a89f3-bdaf-48c0-ad10-f3f71281adf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836d0dd4-7c8f-4750-8d54-b63fcaeed513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Volume 8f90781e-85ad-4789-b8a3-737cfbd809e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f90781e-85ad-4789-b8a3-737cfbd809e2', 'volume_size': 1} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-987950901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f90781e-85ad-4789-b8a3-737cfbd809e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7698ec7e42c47afbfd5509f18c6b13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:31Z,use_quota=True,user_id='2fe184822a254d3a87b99c8ce13b5156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Creating volume 8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:31 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:31 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 1073741824 Sep 25 11:52:31 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:32 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 1073741824" returned: 0 in 0.604s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:32 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 Sep 25 11:52:32 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:32 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2" returned: 0 in 0.369s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836d0dd4-7c8f-4750-8d54-b63fcaeed513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f90781e-85ad-4789-b8a3-737cfbd809e2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dca9338-c1e2-4d6a-a604-792ac83c8e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:32 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Volume volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 (8f90781e-85ad-4789-b8a3-737cfbd809e2): created successfully Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dca9338-c1e2-4d6a-a604-792ac83c8e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Flow 'volume_create_manager' (fbae3d05-f7fa-4661-ba08-b7dfe6066f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:32 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-7bfa5f5b-249d-4447-9d23-c7b1777dad79 tempest-SnapshotDependencyTests-1512691279 None] Created volume successfully. Sep 25 11:52:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Creating offline snapshot fd61e854-8908-4ede-8003-e8e0271773b0 of volume 8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:52:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d5d9c0-99bc-4a5f-a03b-9a5e0cf94b17]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:33 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 Sep 25 11:52:33 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:34 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2" returned: 0 in 0.456s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:34 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 1G Sep 25 11:52:34 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:34 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 1G" returned: 0 in 0.530s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:34 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 Sep 25 11:52:34 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:35 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:35 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 is being set with open permissions: ugo+rw Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:35 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 Sep 25 11:52:35 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:35 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0" returned: 0 in 0.334s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (daf15dd1-c285-47ef-9224-7fd66e30968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e1c00d-bab8-42d5-8392-edd2dec540cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e1c00d-bab8-42d5-8392-edd2dec540cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1969753870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a27914-4630-4632-9bfe-b0a9aca1b6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:35Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20040b79-2a37-4fd9-992b-b11a2e14ce21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20040b79-2a37-4fd9-992b-b11a2e14ce21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc7ad05-97b1-4888-8fb6-e5fe527a2d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc7ad05-97b1-4888-8fb6-e5fe527a2d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a27914-4630-4632-9bfe-b0a9aca1b6b5', 'volume_name': 'volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615d0364-ccae-4259-b6a7-4000859adb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615d0364-ccae-4259-b6a7-4000859adb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9946a813-cbe2-412a-9820-ba01bb42960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Volume a1a27914-4630-4632-9bfe-b0a9aca1b6b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5', 'volume_size': 1} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:35 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.info Sep 25 11:52:35 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:35 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (4d3c6ad7-5e83-42b8-8a39-b25d4ca511f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45cf9d4-4e71-4757-bc1e-ef43a82f1f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.info" returned: 0 in 0.331s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:35 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.info is being set with open permissions: ugo+rw Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45cf9d4-4e71-4757-bc1e-ef43a82f1f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1322335725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:36Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:35 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.info Sep 25 11:52:35 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da54cd2-0323-45b4-b298-3b6003819f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da54cd2-0323-45b4-b298-3b6003819f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b59ef3-9785-4d20-a6e7-7b3b0fb50c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b59ef3-9785-4d20-a6e7-7b3b0fb50c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b', 'volume_name': 'volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf58fe2d-4ece-41b5-90a5-1fbeafc0907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf58fe2d-4ece-41b5-90a5-1fbeafc0907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9338cf-934a-4750-8e14-9857a0516484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:35 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Volume ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b', 'volume_size': 1} Sep 25 11:52:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:36 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.info" returned: 0 in 0.364s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1969753870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a27914-4630-4632-9bfe-b0a9aca1b6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:35Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Creating volume a1a27914-4630-4632-9bfe-b0a9aca1b6b5 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:36 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:36 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 1073741824 Sep 25 11:52:36 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-272d06d2-7aeb-4baf-9e55-8ded2552808d tempest-SnapshotDependencyTests-1512691279 None] Create snapshot completed successfully Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (a55b224b-3b8b-40a5-8619-d3882453ed13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad33dbc6-5a94-436c-a7b1-461f2bd5eefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad33dbc6-5a94-436c-a7b1-461f2bd5eefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-737292893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb0ae90-b66c-4449-b5bf-dd902d259bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:36Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e56623-09b0-4e2f-94bd-8bd4ebf4a189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e56623-09b0-4e2f-94bd-8bd4ebf4a189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f524fb1-7748-4939-b8cd-55869fdee361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f524fb1-7748-4939-b8cd-55869fdee361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb0ae90-b66c-4449-b5bf-dd902d259bc5', 'volume_name': 'volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a15e875-8e97-4f1f-8a45-79067844911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a15e875-8e97-4f1f-8a45-79067844911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3468a6-7475-4962-b4e5-0f60d1b46ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Volume 7eb0ae90-b66c-4449-b5bf-dd902d259bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5', 'volume_size': 1} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (e0c5e4f9-2d0c-44a9-b9ae-b76954411f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d32403-699e-4da0-8e7f-c7dfab25ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d32403-699e-4da0-8e7f-c7dfab25ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-252411774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925d4a24-ff9b-456e-ba52-8222a3abb0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:37Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14db8e5-9425-4f1a-8563-21a94a6daf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14db8e5-9425-4f1a-8563-21a94a6daf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3874dc6b-e5f7-4b19-af15-534a0631db18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3874dc6b-e5f7-4b19-af15-534a0631db18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925d4a24-ff9b-456e-ba52-8222a3abb0c4', 'volume_name': 'volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd9b27e-c4f6-4eec-ac2f-241019c89331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd9b27e-c4f6-4eec-ac2f-241019c89331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2699bb-af0c-4797-a5e8-611ec354ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:36 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Volume 925d4a24-ff9b-456e-ba52-8222a3abb0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4', 'volume_size': 1} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:36 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 1073741824" returned: 0 in 0.684s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:37 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 Sep 25 11:52:37 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (858f7bc0-9346-417a-8262-1a33472abbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ec3e4b-dea9-4fc4-a1bb-9b88d034e0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5" returned: 0 in 0.385s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1322335725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:36Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Creating volume ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:37 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ec3e4b-dea9-4fc4-a1bb-9b88d034e0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277427205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4e2254-80a7-46e6-b02d-f1ad01a09cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:37Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3daf03-78bd-4522-8e88-e07fb55620d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b 1073741824 Sep 25 11:52:37 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3daf03-78bd-4522-8e88-e07fb55620d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76d967e-e2ac-4136-b11b-a31b3540b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76d967e-e2ac-4136-b11b-a31b3540b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4e2254-80a7-46e6-b02d-f1ad01a09cb6', 'volume_name': 'volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc7a436-685b-4cc9-b059-d5555f5fb58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc7a436-685b-4cc9-b059-d5555f5fb58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf604a97-005d-4d80-8649-1e11940816d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Volume ae4e2254-80a7-46e6-b02d-f1ad01a09cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6', 'volume_size': 1} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9946a813-cbe2-412a-9820-ba01bb42960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b39612-0948-46be-95c0-060fb83ea594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Volume volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 (a1a27914-4630-4632-9bfe-b0a9aca1b6b5): created successfully Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b39612-0948-46be-95c0-060fb83ea594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (daf15dd1-c285-47ef-9224-7fd66e30968b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e2e1c0b9-184b-4dd3-b45a-8d3a65ce5e5a tempest-CreateVolumesFromImageTest-1280797354 None] Created volume successfully. Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Flow 'volume_create_manager' (cf0c4602-ee86-4a06-9c2d-b15e8dbe3fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7647a596-a537-4294-bfe6-43537776abf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7647a596-a537-4294-bfe6-43537776abf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7698ec7e42c47afbfd5509f18c6b13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd61e854-8908-4ede-8003-e8e0271773b0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:38Z,use_quota=True,user_id='2fe184822a254d3a87b99c8ce13b5156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7ebefe-3386-4d68-bbc1-b5584e5599ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7ebefe-3386-4d68-bbc1-b5584e5599ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a618d9ee-4f35-4c46-a19c-b34c93dc3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a618d9ee-4f35-4c46-a19c-b34c93dc3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd754ae4a-7d01-4a78-b7d3-9b792c3f6d5b', 'volume_name': 'volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b', 'volume_size': 1, 'snapshot_id': 'fd61e854-8908-4ede-8003-e8e0271773b0'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6572ab6e-7253-4bbe-82af-00998389316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6572ab6e-7253-4bbe-82af-00998389316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfcee6a-abfd-44f1-96dc-6949160aa98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Volume d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b', 'volume_size': 1, 'snapshot_id': 'fd61e854-8908-4ede-8003-e8e0271773b0'} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:37 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b 1073741824" returned: 0 in 0.560s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:38 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b Sep 25 11:52:38 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:38 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b" returned: 0 in 0.307s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-737292893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb0ae90-b66c-4449-b5bf-dd902d259bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:36Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Creating volume 7eb0ae90-b66c-4449-b5bf-dd902d259bc5 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:38 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9338cf-934a-4750-8e14-9857a0516484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:38 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 1073741824 Sep 25 11:52:38 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314d87e0-baca-4141-be50-e9df0359c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:38 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Volume volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b (ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b): created successfully Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314d87e0-baca-4141-be50-e9df0359c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (4d3c6ad7-5e83-42b8-8a39-b25d4ca511f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:38 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a6dd5f5c-8691-4d7d-b778-c0d354252905 tempest-CreateVolumesFromImageTest-1280797354 None] Created volume successfully. Sep 25 11:52:38 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 1073741824" returned: 0 in 0.517s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:38 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 Sep 25 11:52:38 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:39 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5" returned: 0 in 0.357s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.448s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-252411774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925d4a24-ff9b-456e-ba52-8222a3abb0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:37Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Creating volume 925d4a24-ff9b-456e-ba52-8222a3abb0c4 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:39 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3468a6-7475-4962-b4e5-0f60d1b46ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add47a23-0051-4375-91eb-2f5f9e738d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:39 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 1073741824 Sep 25 11:52:39 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:39 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Volume volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 (7eb0ae90-b66c-4449-b5bf-dd902d259bc5): created successfully Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add47a23-0051-4375-91eb-2f5f9e738d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (a55b224b-3b8b-40a5-8619-d3882453ed13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:39 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d7786099-d3cc-4d38-8584-10019b16a4f4 tempest-CreateVolumesFromImageTest-1280797354 None] Created volume successfully. Sep 25 11:52:39 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 1073741824" returned: 0 in 0.633s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:40 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 Sep 25 11:52:40 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:40 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4" returned: 0 in 0.310s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.842s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277427205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4e2254-80a7-46e6-b02d-f1ad01a09cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15ac3f48c2446cdadc6971646335364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:37Z,use_quota=True,user_id='4642e46db3924e0aa30160cb966b4105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Creating volume ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:40 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2699bb-af0c-4797-a5e8-611ec354ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6881fdd6-c1d3-47b1-b19a-d579df35e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:40 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 1073741824 Sep 25 11:52:40 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:40 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Volume volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 (925d4a24-ff9b-456e-ba52-8222a3abb0c4): created successfully Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6881fdd6-c1d3-47b1-b19a-d579df35e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (e0c5e4f9-2d0c-44a9-b9ae-b76954411f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:40 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-72ce7ff2-8613-4334-9681-bd6cd965f24c tempest-CreateVolumesFromImageTest-1280797354 None] Created volume successfully. Sep 25 11:52:40 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 1073741824" returned: 0 in 0.573s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:40 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 Sep 25 11:52:40 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:41 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6" returned: 0 in 0.302s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.472s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-quobyte-fd61e854-8908-4ede-8003-e8e0271773b0-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf604a97-005d-4d80-8649-1e11940816d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8e20ce-d8a5-43ad-a205-647523d3bb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-fd61e854-8908-4ede-8003-e8e0271773b0-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Creating volume d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b from snapshot fd61e854-8908-4ede-8003-e8e0271773b0 {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-quobyte-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:41 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Volume volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 (ae4e2254-80a7-46e6-b02d-f1ad01a09cb6): created successfully Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8e20ce-d8a5-43ad-a205-647523d3bb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Flow 'volume_create_manager' (858f7bc0-9346-417a-8262-1a33472abbbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] snapshot: fd61e854-8908-4ede-8003-e8e0271773b0, volume: d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:41 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-256d5c91-3c93-42b3-ab75-f4145e2329cf tempest-CreateVolumesFromImageTest-1280797354 None] Created volume successfully. Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64eb966-246f-4f17-8e46-a8d6adac962a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:41 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 Sep 25 11:52:41 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:41 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0" returned: 0 in 0.473s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f90781e-85ad-4789-b8a3-737cfbd809e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb304c86-0dbb-4371-84f7-12d2afe19522]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-quobyte-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:42 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 Sep 25 11:52:42 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb861433-f5f2-4766-939d-68759bb37eeb]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:42 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 Sep 25 11:52:42 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:42 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2" returned: 0 in 0.489s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:42 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b Sep 25 11:52:42 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:42 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6" returned: 0 in 0.422s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:42 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6 Sep 25 11:52:42 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:42 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6" returned: 0 in 0.338s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6" released by "delete_volume" :: held 0.816s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=83,cinder:UPDATE=101,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:52:42 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Created reservations ['0771cb04-9073-4ebe-a966-15b70442c3be', 'f6d7a061-18c4-4aea-b22e-5825da3d2c8f', '98ae5b88-d710-43d6-898b-b4925b2652ea', '6a5ac2bc-5b4e-4069-a471-132a30b681f3'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:43 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:43 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-925d4a24-ff9b-456e-ba52-8222a3abb0c4-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-925d4a24-ff9b-456e-ba52-8222a3abb0c4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-quobyte-925d4a24-ff9b-456e-ba52-8222a3abb0c4" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-925d4a24-ff9b-456e-ba52-8222a3abb0c4" acquired by "delete_volume" :: waited 0.051s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cef2d7-c3c4-4f4b-a9be-80c573a6b98b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:43 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.547s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:43 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Deleted volume successfully. Sep 25 11:52:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f6aacef1-9978-4d8d-94f8-9999739d4750 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-ae4e2254-80a7-46e6-b02d-f1ad01a09cb6-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:43 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 Sep 25 11:52:43 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:44 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4" returned: 0 in 0.779s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:44 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4 Sep 25 11:52:44 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:44 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-925d4a24-ff9b-456e-ba52-8222a3abb0c4" returned: 0 in 0.485s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-925d4a24-ff9b-456e-ba52-8222a3abb0c4" released by "delete_volume" :: held 1.366s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Created reservations ['893b47dd-122a-4c59-8abf-18f5a475d58e', 'e26087e0-1285-4398-adc8-98635f899ebd', '0f6d6cc9-c521-4ef0-96af-cedb3e839624', 'dec87929-b3fb-4073-ad08-36133092eaad'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:45 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:45 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:45 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.450s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Deleted volume successfully. Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3757cd4-c3dd-4897-865c-b2bdbcaebc2a tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-925d4a24-ff9b-456e-ba52-8222a3abb0c4-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-7eb0ae90-b66c-4449-b5bf-dd902d259bc5-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-7eb0ae90-b66c-4449-b5bf-dd902d259bc5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-quobyte-7eb0ae90-b66c-4449-b5bf-dd902d259bc5" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-7eb0ae90-b66c-4449-b5bf-dd902d259bc5" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[856447e8-fb53-4bc4-bf80-f9a5db0634e2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:46 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 Sep 25 11:52:46 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:46 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5" returned: 0 in 0.573s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:46 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5 Sep 25 11:52:46 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:47 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7eb0ae90-b66c-4449-b5bf-dd902d259bc5" returned: 0 in 0.410s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-7eb0ae90-b66c-4449-b5bf-dd902d259bc5" released by "delete_volume" :: held 1.096s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Created reservations ['b6bf2100-737c-477f-9938-de7b27ef48ca', 'fe3bca30-3ec1-4aa9-b54b-3dfa5fb8bb82', 'e3623605-a26e-4a27-b55c-a9c585c8d848', 'e900c97d-9968-4942-b783-44d09b489e7a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:47 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:47 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:48 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.540s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:48 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Deleted volume successfully. Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4cfb36eb-444a-411c-a302-8fe46c3e28c5 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-7eb0ae90-b66c-4449-b5bf-dd902d259bc5-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-quobyte-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b" acquired by "delete_volume" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b836a01-7857-4778-9da3-3374c09833fa]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:48 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b Sep 25 11:52:48 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:49 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b" returned: 0 in 0.646s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:49 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b Sep 25 11:52:49 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:49 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b" returned: 0 in 0.408s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b" released by "delete_volume" :: held 1.141s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Created reservations ['0b60b638-c322-4875-822b-5b515bc8656c', '7d2ad35b-503a-42bc-99a7-81736fabaa52', '0f8e534d-f22e-4260-8f92-6c4ea4618bab', '25f41cba-c347-4be9-824b-64971cfc84a9'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:49 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" returned: 0 in 7.432s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:52:49 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Converted 1024.00 MB image at 137.77 MB/s Sep 25 11:52:49 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b is being set with open permissions: ugo+rw Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:49 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b Sep 25 11:52:49 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:49 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:49 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:50 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" returned: 0 in 0.279s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" released by "_copy_volume_from_snapshot" :: held 8.807s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-fd61e854-8908-4ede-8003-e8e0271773b0-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" released by "_create_volume_from_snapshot" :: held 8.898s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.934s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:50 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfcee6a-abfd-44f1-96dc-6949160aa98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b', 'volume_size': 1, 'snapshot_id': 'fd61e854-8908-4ede-8003-e8e0271773b0'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60de88ed-c42f-47b7-8288-ab8e431239b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.297s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Deleted volume successfully. Sep 25 11:52:50 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Volume volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b (d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b): created successfully Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60de88ed-c42f-47b7-8288-ab8e431239b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Flow 'volume_create_manager' (cf0c4602-ee86-4a06-9c2d-b15e8dbe3fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7ecc7e66-701a-41d4-85c7-b8271af266eb tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-ee7b40d4-c6f5-46bf-92ae-5a283c9adb9b-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-672f17d6-e2f3-4337-9dc1-5f1ad1fc8fd9 tempest-SnapshotDependencyTests-1512691279 None] Created volume successfully. Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-a1a27914-4630-4632-9bfe-b0a9aca1b6b5-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-a1a27914-4630-4632-9bfe-b0a9aca1b6b5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "cinder-quobyte-a1a27914-4630-4632-9bfe-b0a9aca1b6b5" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-fd61e854-8908-4ede-8003-e8e0271773b0-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-a1a27914-4630-4632-9bfe-b0a9aca1b6b5" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-fd61e854-8908-4ede-8003-e8e0271773b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-quobyte-8f90781e-85ad-4789-b8a3-737cfbd809e2" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b8abca-d13e-450a-997a-129fe6695a09]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-8f90781e-85ad-4789-b8a3-737cfbd809e2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-quobyte-fd61e854-8908-4ede-8003-e8e0271773b0" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-fd61e854-8908-4ede-8003-e8e0271773b0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Deleting offline snapshot fd61e854-8908-4ede-8003-e8e0271773b0 of volume 8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] snapshot_file for this snap is: volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee458c5f-8517-4ea0-a0a3-897b6288c6f1]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:51 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 Sep 25 11:52:51 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:51 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 Sep 25 11:52:51 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:51 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5" returned: 0 in 0.390s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:51 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5 Sep 25 11:52:51 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:51 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0" returned: 0 in 0.391s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f90781e-85ad-4789-b8a3-737cfbd809e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31e0c21-e3e9-417c-b435-c9c9e4588d5b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:51 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 Sep 25 11:52:51 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:51 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a1a27914-4630-4632-9bfe-b0a9aca1b6b5" returned: 0 in 0.251s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-quobyte-a1a27914-4630-4632-9bfe-b0a9aca1b6b5" released by "delete_volume" :: held 0.693s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Created reservations ['17f2eac0-96ee-472e-99e8-f386b962a77c', '535356d4-9c4c-4184-beef-d58f9bc9c477', '73259114-8de2-493f-a7cc-c89882f3b64f', '3056d4a3-6dcc-48c8-84dd-f57b19e537e8'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:51 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:51 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:51 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.272s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:51 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Deleted volume successfully. Sep 25 11:52:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4ad775ac-faa8-4208-9ee3-0c3b83dac1a0 tempest-CreateVolumesFromImageTest-1280797354 None] Lock "cinder-a1a27914-4630-4632-9bfe-b0a9aca1b6b5-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:52 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2" returned: 0 in 0.610s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:52 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 Sep 25 11:52:52 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:52 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0" returned: 0 in 0.441s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:52 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0 Sep 25 11:52:52 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:52 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2.fd61e854-8908-4ede-8003-e8e0271773b0" returned: 0 in 0.334s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-fd61e854-8908-4ede-8003-e8e0271773b0" released by "_delete_snapshot" :: held 1.938s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-8f90781e-85ad-4789-b8a3-737cfbd809e2" released by "delete_snapshot" :: held 1.966s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:53 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Created reservations ['0e5c81d1-a241-4062-bea6-91639216cbc7', '8100b200-f8f8-4d56-a87d-b1f6a538f366', '0b804107-ed24-4bbb-9797-cee9e448d89a', '3901a6d5-b991-47f5-a84c-5efb74885ac6'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Delete snapshot completed successfully. Sep 25 11:52:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-98692d94-c003-4f6e-9ce1-2ec49e3387cf tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-fd61e854-8908-4ede-8003-e8e0271773b0-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-8f90781e-85ad-4789-b8a3-737cfbd809e2-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-8f90781e-85ad-4789-b8a3-737cfbd809e2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-quobyte-8f90781e-85ad-4789-b8a3-737cfbd809e2" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-8f90781e-85ad-4789-b8a3-737cfbd809e2" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0ebb02-752f-4409-bfe0-2a60ddf4214e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:54 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 Sep 25 11:52:54 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:54 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2" returned: 0 in 0.400s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:54 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2 Sep 25 11:52:54 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:54 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8f90781e-85ad-4789-b8a3-737cfbd809e2" returned: 0 in 0.290s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-8f90781e-85ad-4789-b8a3-737cfbd809e2" released by "delete_volume" :: held 0.773s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Created reservations ['f225c93d-3cb1-408b-8f00-dbc6524e46d1', '708f47db-e15f-4a59-a2b9-704dd02cd7c7', 'cf5317c6-9bf1-45d3-88ee-2497a0a50e69', 'd64adf57-8100-4c3b-b9a2-c7f3e380ff43'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:55 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:55 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:55 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (096891e4-45d0-4072-9b0b-39a672a901e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09172bcb-3230-44dc-9452-768ae6136e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "cinder-quobyte-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.386s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09172bcb-3230-44dc-9452-768ae6136e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1389481785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f09a142-a98f-4f85-9b1f-dc95fcb76104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:55Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f05f7cb-147a-4f19-80a0-887e4e374fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f05f7cb-147a-4f19-80a0-887e4e374fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b318ca4-3e9c-4533-b67f-e906e6cd7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b318ca4-3e9c-4533-b67f-e906e6cd7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f09a142-a98f-4f85-9b1f-dc95fcb76104', 'volume_name': 'volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735e3d6d-b777-40ad-a1e0-6d0b733a286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735e3d6d-b777-40ad-a1e0-6d0b733a286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca7c717-445d-4795-800e-6094435d8262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:55 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume 6f09a142-a98f-4f85-9b1f-dc95fcb76104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104', 'volume_size': 1} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1389481785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f09a142-a98f-4f85-9b1f-dc95fcb76104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:55Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Creating volume 6f09a142-a98f-4f85-9b1f-dc95fcb76104 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:55 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Deleted volume successfully. Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" acquired by "delete_volume" :: waited 0.097s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:55 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 1073741824 Sep 25 11:52:55 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-79c843f2-a1b5-4d44-abd8-df608c7787ae tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-8f90781e-85ad-4789-b8a3-737cfbd809e2-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf261b7-619d-4f7b-84a7-7179b4531788]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:55 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b Sep 25 11:52:55 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:56 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" returned: 0 in 0.411s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:56 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 1073741824" returned: 0 in 0.492s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:56 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b Sep 25 11:52:56 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:56 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 Sep 25 11:52:56 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:56 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104" returned: 0 in 0.264s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:56 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca7c717-445d-4795-800e-6094435d8262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45140817-a4c4-4a90-8b46-39bc218233f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" returned: 0 in 0.346s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-quobyte-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b" released by "delete_volume" :: held 0.810s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:56 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 (6f09a142-a98f-4f85-9b1f-dc95fcb76104): created successfully Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45140817-a4c4-4a90-8b46-39bc218233f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (096891e4-45d0-4072-9b0b-39a672a901e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-40d4a386-b3d1-4ec3-b491-024db2a37cab tempest-CreateVolumesFromSnapshotTest-410907853 None] Created volume successfully. Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Created reservations ['865e6a26-e0d2-4292-a66d-487c12ffa748', '377f079d-d2fb-4d68-a447-f3360f0cbcf3', 'feff2f56-db21-4167-9a3e-6d618e485ade', 'a0ac8d60-3b3b-40b7-b22d-4876009e1063'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:56 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:52:56 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:56 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.253s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Deleted volume successfully. Sep 25 11:52:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f626b33b-aba7-48fa-baa1-9888cd474aae tempest-SnapshotDependencyTests-1512691279 None] Lock "cinder-d754ae4a-7d01-4a78-b7d3-9b792c3f6d5b-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Creating offline snapshot 62c7593e-4d84-4d3c-b692-f1a2dabe2974 of volume 6f09a142-a98f-4f85-9b1f-dc95fcb76104 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:52:57 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e99e334-27de-44b1-8067-81e707cbbd08]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:57 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 Sep 25 11:52:57 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:58 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104" returned: 0 in 0.415s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:58 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 1G Sep 25 11:52:58 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:58 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 1G" returned: 0 in 0.533s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:58 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 Sep 25 11:52:58 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:59 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974" returned: 0 in 0.337s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:59 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 is being set with open permissions: ugo+rw Sep 25 11:52:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:59 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 Sep 25 11:52:59 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:59 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974" returned: 0 in 0.309s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:59 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.info Sep 25 11:52:59 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:59 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.info" returned: 0 in 0.298s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:59 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.info is being set with open permissions: ugo+rw Sep 25 11:52:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:59 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.info Sep 25 11:52:59 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:00 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.info" returned: 0 in 0.276s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0915d49b-345b-4af9-96b6-907ea1d75729 tempest-CreateVolumesFromSnapshotTest-410907853 None] Create snapshot completed successfully Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (87192b43-cf6b-4a20-9ab5-d922f15e652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5863d37c-586a-41da-9c6e-ddfed7274de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5863d37c-586a-41da-9c6e-ddfed7274de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1691064112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f1e9c8-5ba2-42c4-b42b-63e85c56ce49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:01Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740955af-24a6-47c8-ae14-432866ed8c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740955af-24a6-47c8-ae14-432866ed8c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b03be5-b1a5-4122-9c40-3004841e5133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b03be5-b1a5-4122-9c40-3004841e5133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f1e9c8-5ba2-42c4-b42b-63e85c56ce49', 'volume_name': 'volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0c4276-a65d-4a10-b23d-8dc8ddce746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0c4276-a65d-4a10-b23d-8dc8ddce746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a916b7d-8bd0-43a8-938e-a97fe11170f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume 00f1e9c8-5ba2-42c4-b42b-63e85c56ce49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49', 'volume_size': 1} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1691064112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f1e9c8-5ba2-42c4-b42b-63e85c56ce49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:01Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Creating volume 00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:01 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:01 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 1073741824 Sep 25 11:53:01 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (49906d86-44b5-4454-bd05-193c622802a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46f9421-9231-468e-9efa-07982c2c3537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46f9421-9231-468e-9efa-07982c2c3537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1819978481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b5e8da-fa4e-4efd-b63c-840235a1b51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:02Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be880e3d-1753-479f-ba49-6eb35875ae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be880e3d-1753-479f-ba49-6eb35875ae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf62d58a-98c4-49af-a01f-4684e69d4933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf62d58a-98c4-49af-a01f-4684e69d4933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b5e8da-fa4e-4efd-b63c-840235a1b51b', 'volume_name': 'volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9dbeb94-c5ce-4d97-8f21-b81fb8bd2300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9dbeb94-c5ce-4d97-8f21-b81fb8bd2300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca31c9a-43d2-42e6-a059-fad079fa0bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume 50b5e8da-fa4e-4efd-b63c-840235a1b51b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b', 'volume_size': 1} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:02 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 1073741824" returned: 0 in 0.674s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:02 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 Sep 25 11:53:02 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (20b6ba60-9723-4512-b228-e2d5636759b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce7ea87-1b9c-43e2-9cdb-0d1f86a62d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce7ea87-1b9c-43e2-9cdb-0d1f86a62d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368968103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8aa716-21a7-4d65-9c1b-9d34788bbcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:02Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c4697-cff2-443e-a416-2682b799f2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c4697-cff2-443e-a416-2682b799f2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f8cc6b-7662-40a1-8367-29072b0ee27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f8cc6b-7662-40a1-8367-29072b0ee27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8aa716-21a7-4d65-9c1b-9d34788bbcb5', 'volume_name': 'volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944f76e2-3789-4eab-917e-ca5363f2e399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944f76e2-3789-4eab-917e-ca5363f2e399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db78a460-7d6e-4988-a1ee-949e64586a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume 5f8aa716-21a7-4d65-9c1b-9d34788bbcb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5', 'volume_size': 1} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:02 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49" returned: 0 in 0.442s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1819978481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b5e8da-fa4e-4efd-b63c-840235a1b51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:02Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Creating volume 50b5e8da-fa4e-4efd-b63c-840235a1b51b {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:02 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a916b7d-8bd0-43a8-938e-a97fe11170f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b 1073741824 Sep 25 11:53:02 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20671a1c-1f96-4d67-9a1c-779796c636df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 (00f1e9c8-5ba2-42c4-b42b-63e85c56ce49): created successfully Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20671a1c-1f96-4d67-9a1c-779796c636df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (87192b43-cf6b-4a20-9ab5-d922f15e652d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:02 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-171f0efa-cd86-4056-93e1-482d63a54317 tempest-CreateVolumesFromSnapshotTest-410907853 None] Created volume successfully. Sep 25 11:53:02 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (6413fa98-3804-4bc4-a133-0db74401df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac91294-576b-40ac-bed7-3ea1a6798b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac91294-576b-40ac-bed7-3ea1a6798b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927816682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71082243-c3bd-4e36-bde1-44a5eb2bd625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:03Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3c7c43-d820-4242-9f83-15e73aa947ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3c7c43-d820-4242-9f83-15e73aa947ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124889d6-2d97-467e-b598-444d0766bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124889d6-2d97-467e-b598-444d0766bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71082243-c3bd-4e36-bde1-44a5eb2bd625', 'volume_name': 'volume-71082243-c3bd-4e36-bde1-44a5eb2bd625', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819caaa4-0bdb-4130-ac19-9b53608387a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819caaa4-0bdb-4130-ac19-9b53608387a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a77a01-26fb-41fd-9e7d-109007a959f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume 71082243-c3bd-4e36-bde1-44a5eb2bd625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71082243-c3bd-4e36-bde1-44a5eb2bd625', 'volume_size': 1} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:03 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (023bdd82-1650-4c85-a64b-73e5cc9defb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c11e176-02d6-4ce7-bc55-e354a452ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b 1073741824" returned: 0 in 0.739s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c11e176-02d6-4ce7-bc55-e354a452ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482165628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdfffd3-47c5-46a4-9f5f-5986ead26c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:03Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5006706-8721-4d55-a02e-a1db2bbe5e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5006706-8721-4d55-a02e-a1db2bbe5e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813896a3-2059-4a66-a49b-e95d15d18403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813896a3-2059-4a66-a49b-e95d15d18403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bdfffd3-47c5-46a4-9f5f-5986ead26c53', 'volume_name': 'volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a0e970-7f21-4730-9ba6-cba47a091dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a0e970-7f21-4730-9ba6-cba47a091dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bf7d6f-23da-4881-a7b9-e78f9784d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume 4bdfffd3-47c5-46a4-9f5f-5986ead26c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53', 'volume_size': 1} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:03 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b Sep 25 11:53:03 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:03 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b" returned: 0 in 0.328s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368968103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8aa716-21a7-4d65-9c1b-9d34788bbcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:02Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Creating volume 5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:03 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca31c9a-43d2-42e6-a059-fad079fa0bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 1073741824 Sep 25 11:53:03 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685429eb-3aaa-4522-b542-98c53783de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:03 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b (50b5e8da-fa4e-4efd-b63c-840235a1b51b): created successfully Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685429eb-3aaa-4522-b542-98c53783de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:03 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (49906d86-44b5-4454-bd05-193c622802a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6e533ef7-0cbe-45bd-8594-a5a9ef4286bb tempest-CreateVolumesFromSnapshotTest-410907853 None] Created volume successfully. Sep 25 11:53:04 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 1073741824" returned: 0 in 0.556s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:04 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 Sep 25 11:53:04 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:04 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5" returned: 0 in 0.259s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.620s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927816682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71082243-c3bd-4e36-bde1-44a5eb2bd625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:03Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Creating volume 71082243-c3bd-4e36-bde1-44a5eb2bd625 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:04 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db78a460-7d6e-4988-a1ee-949e64586a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:04 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 1073741824 Sep 25 11:53:04 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b227b8b5-26f9-4372-9e3a-1ee7e1e150d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:04 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 (5f8aa716-21a7-4d65-9c1b-9d34788bbcb5): created successfully Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b227b8b5-26f9-4372-9e3a-1ee7e1e150d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (20b6ba60-9723-4512-b228-e2d5636759b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1e762aa5-e73b-4e98-a027-c7acb23b01de tempest-CreateVolumesFromSnapshotTest-410907853 None] Created volume successfully. Sep 25 11:53:05 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 1073741824" returned: 0 in 0.532s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:05 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 Sep 25 11:53:05 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:05 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625" returned: 0 in 0.354s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.191s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482165628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdfffd3-47c5-46a4-9f5f-5986ead26c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a8325d77754435bc5878af34259b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:03Z,use_quota=True,user_id='c920fc78bd5449728c7e6c7b6a812265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Creating volume 4bdfffd3-47c5-46a4-9f5f-5986ead26c53 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:05 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:05 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 1073741824 Sep 25 11:53:05 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a77a01-26fb-41fd-9e7d-109007a959f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71082243-c3bd-4e36-bde1-44a5eb2bd625', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e131be19-481c-4d5d-bdee-a6eafcdd6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:05 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 (71082243-c3bd-4e36-bde1-44a5eb2bd625): created successfully Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e131be19-481c-4d5d-bdee-a6eafcdd6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (6413fa98-3804-4bc4-a133-0db74401df5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b09e5f30-f8c5-472b-a6e3-0e444beb50a0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Created volume successfully. Sep 25 11:53:06 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 1073741824" returned: 0 in 0.526s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:06 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 Sep 25 11:53:06 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:06 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53" returned: 0 in 0.338s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bf7d6f-23da-4881-a7b9-e78f9784d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b783d6a5-3cda-419d-8dab-8ef961c19050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:06 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Volume volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 (4bdfffd3-47c5-46a4-9f5f-5986ead26c53): created successfully Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b783d6a5-3cda-419d-8dab-8ef961c19050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Flow 'volume_create_manager' (023bdd82-1650-4c85-a64b-73e5cc9defb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:06 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c4e3aa92-7660-4c0a-9869-7914696a7066 tempest-CreateVolumesFromSnapshotTest-410907853 None] Created volume successfully. Sep 25 11:53:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-4bdfffd3-47c5-46a4-9f5f-5986ead26c53-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-4bdfffd3-47c5-46a4-9f5f-5986ead26c53-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-quobyte-4bdfffd3-47c5-46a4-9f5f-5986ead26c53" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-4bdfffd3-47c5-46a4-9f5f-5986ead26c53" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:07 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c156930c-67e0-468d-a68c-563a002e49c3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:07 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 Sep 25 11:53:07 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:07 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53" returned: 0 in 0.538s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:07 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53 Sep 25 11:53:07 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:08 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4bdfffd3-47c5-46a4-9f5f-5986ead26c53" returned: 0 in 0.343s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-4bdfffd3-47c5-46a4-9f5f-5986ead26c53" released by "delete_volume" :: held 0.939s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Created reservations ['3895154c-d493-43e9-859c-4e1845897c90', '22f87d3f-6b75-4de6-97fd-b54206eff466', 'dba5df80-e41c-441e-bb12-40b9f19e60fb', 'b666d230-5571-475e-984e-8dd9518393cc'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:08 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:08 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:08 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.365s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:08 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Deleted volume successfully. Sep 25 11:53:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-9d9655f7-7b31-40f9-be3f-9ea69358c6f0 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-4bdfffd3-47c5-46a4-9f5f-5986ead26c53-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-71082243-c3bd-4e36-bde1-44a5eb2bd625-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-71082243-c3bd-4e36-bde1-44a5eb2bd625-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-quobyte-71082243-c3bd-4e36-bde1-44a5eb2bd625" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-71082243-c3bd-4e36-bde1-44a5eb2bd625" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b5f3c0-fe76-4fd2-a05b-91bc56ffc51b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:09 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 Sep 25 11:53:09 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:09 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625" returned: 0 in 0.456s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:09 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625 Sep 25 11:53:09 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:10 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-71082243-c3bd-4e36-bde1-44a5eb2bd625" returned: 0 in 0.312s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-71082243-c3bd-4e36-bde1-44a5eb2bd625" released by "delete_volume" :: held 0.831s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Created reservations ['ab52ce27-553f-4a64-8ba3-638248656837', '48b6e8ce-d211-4ee1-9cec-67b32cafa2d5', '9c730b79-38e6-4e56-9423-d5a4eaedd676', '445843ba-952f-4c77-86ec-8d012cab481a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:10 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:10 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-quobyte-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[764c23e6-e482-4368-9432-ff81234135da]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:10 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.362s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Deleted volume successfully. Sep 25 11:53:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-af24f0b8-5602-419d-9b72-2383bd502871 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-71082243-c3bd-4e36-bde1-44a5eb2bd625-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:10 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 Sep 25 11:53:10 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:11 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5" returned: 0 in 0.443s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:11 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5 Sep 25 11:53:11 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:11 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5" returned: 0 in 0.285s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5" released by "delete_volume" :: held 0.781s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Created reservations ['24eeeb0c-e59b-4311-a4b0-6bd4be021a4b', 'c4c2d65b-c7d8-4dc4-966c-eaea2c208271', '10fa77d6-44f3-4523-91f7-1e1071861e94', '063bfead-449b-4507-875e-4f8bc4293d7e'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:11 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:11 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-50b5e8da-fa4e-4efd-b63c-840235a1b51b-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-50b5e8da-fa4e-4efd-b63c-840235a1b51b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-quobyte-50b5e8da-fa4e-4efd-b63c-840235a1b51b" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-50b5e8da-fa4e-4efd-b63c-840235a1b51b" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc1bc6-1f2e-4849-9e76-225b1ab3c10f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:11 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.345s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Deleted volume successfully. Sep 25 11:53:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1beeff3e-648b-4711-93ea-178b415ffddc tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-5f8aa716-21a7-4d65-9c1b-9d34788bbcb5-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:12 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b Sep 25 11:53:12 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:12 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b" returned: 0 in 0.398s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:12 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b Sep 25 11:53:12 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:12 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-50b5e8da-fa4e-4efd-b63c-840235a1b51b" returned: 0 in 0.312s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-50b5e8da-fa4e-4efd-b63c-840235a1b51b" released by "delete_volume" :: held 0.760s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Created reservations ['b42b7d7a-ffea-4992-8ae3-2d587168a442', '00e35938-f7a7-408c-bd73-3186eead4ad6', '4a07b9a6-38c3-4bc4-8526-195f16a584fd', 'fb6046b2-e939-4303-a820-73bdfc5eba97'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:12 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:12 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-quobyte-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:13 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.297s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Deleted volume successfully. Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee525701-5d0b-401d-be51-0f5dcade4509]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-946854fe-627b-416a-bf12-137547139b88 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-50b5e8da-fa4e-4efd-b63c-840235a1b51b-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:13 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 Sep 25 11:53:13 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:13 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49" returned: 0 in 0.375s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:13 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49 Sep 25 11:53:13 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:13 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49" returned: 0 in 0.292s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49" released by "delete_volume" :: held 0.718s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:13 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Created reservations ['d754fb1a-0667-472f-812d-3cbec2b0e110', 'fff79cde-4ce4-40b8-8f16-06ac46e04396', 'e1d6438a-772e-4432-bbb5-08b7457e9635', '3168bf1b-9c5f-4d79-9a45-32bba8507f66'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:14 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:14 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-62c7593e-4d84-4d3c-b692-f1a2dabe2974-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-62c7593e-4d84-4d3c-b692-f1a2dabe2974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-quobyte-6f09a142-a98f-4f85-9b1f-dc95fcb76104" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-6f09a142-a98f-4f85-9b1f-dc95fcb76104" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-quobyte-62c7593e-4d84-4d3c-b692-f1a2dabe2974" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-62c7593e-4d84-4d3c-b692-f1a2dabe2974" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Deleting offline snapshot 62c7593e-4d84-4d3c-b692-f1a2dabe2974 of volume 6f09a142-a98f-4f85-9b1f-dc95fcb76104 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] snapshot_file for this snap is: volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6730473-f40d-4539-af6d-37989eb002f7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:14 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.292s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Deleted volume successfully. Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b308a03-0d4c-4923-a40a-1095c114024c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-00f1e9c8-5ba2-42c4-b42b-63e85c56ce49-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:14 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 Sep 25 11:53:14 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:14 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974" returned: 0 in 0.449s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfb2b72-ca1c-4225-9d17-c42164eae743]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:14 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 Sep 25 11:53:14 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:15 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104" returned: 0 in 0.385s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:15 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 Sep 25 11:53:15 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:15 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974" returned: 0 in 0.367s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:15 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974 Sep 25 11:53:15 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:15 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104.62c7593e-4d84-4d3c-b692-f1a2dabe2974" returned: 0 in 0.371s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-62c7593e-4d84-4d3c-b692-f1a2dabe2974" released by "_delete_snapshot" :: held 1.713s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-6f09a142-a98f-4f85-9b1f-dc95fcb76104" released by "delete_snapshot" :: held 1.740s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Created reservations ['18280a17-eb9d-4a0d-b52c-daf610287eb8', 'edbdfdee-fd43-4753-b8fd-bcc050f549a7', '4637e676-544c-4591-9495-605a8c2f772c', '78bf6fdc-ed16-46f7-8686-d1e37dc21c76'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Delete snapshot completed successfully. Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-28157fd9-8fb7-4736-8685-95e4b0b1960c tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-62c7593e-4d84-4d3c-b692-f1a2dabe2974-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-6f09a142-a98f-4f85-9b1f-dc95fcb76104-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-6f09a142-a98f-4f85-9b1f-dc95fcb76104-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "cinder-quobyte-6f09a142-a98f-4f85-9b1f-dc95fcb76104" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-6f09a142-a98f-4f85-9b1f-dc95fcb76104" acquired by "delete_volume" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[63414703-92da-43c4-9d2b-0e9ee0240df3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:16 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 Sep 25 11:53:16 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:16 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104" returned: 0 in 0.418s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:16 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104 Sep 25 11:53:16 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:17 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6f09a142-a98f-4f85-9b1f-dc95fcb76104" returned: 0 in 0.280s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-quobyte-6f09a142-a98f-4f85-9b1f-dc95fcb76104" released by "delete_volume" :: held 0.774s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Created reservations ['71e85722-12e1-4eda-adb9-7b956b24e1a7', 'aa591875-798c-426a-9e85-df3bdf6fb035', '4cc4e721-76a4-4d5e-ad24-414b9de29c71', '0197c0c2-3bd5-4c6e-be7c-f9d99d11aebe'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:17 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:17 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:17 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.263s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Deleted volume successfully. Sep 25 11:53:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a040190f-23e4-42fc-a8fb-717018425d29 tempest-CreateVolumesFromSnapshotTest-410907853 None] Lock "cinder-6f09a142-a98f-4f85-9b1f-dc95fcb76104-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Flow 'volume_create_manager' (dbef457e-5b4d-4d77-87d8-01d1ad7ff7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1180e6f-8279-4d53-979c-1759e761935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1180e6f-8279-4d53-979c-1759e761935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1f7d31-02c0-4719-a8e2-1206cdb3de7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada434e584b46d9ae0cdba571e009cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:21Z,use_quota=True,user_id='f9167c0a6af8407bb70a73557f6a2529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41da5654-8252-4bfc-aa21-3dc959a79682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41da5654-8252-4bfc-aa21-3dc959a79682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3dc32d-99f2-4c5f-be3a-14c113eb7a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3dc32d-99f2-4c5f-be3a-14c113eb7a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1f7d31-02c0-4719-a8e2-1206cdb3de7a', 'volume_name': 'volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3446b54-ec20-4b70-830c-08c11859d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3446b54-ec20-4b70-830c-08c11859d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f45425-58fe-4891-a56e-fdceaf2c6d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:21 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Volume dd1f7d31-02c0-4719-a8e2-1206cdb3de7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a', 'volume_size': 1} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1f7d31-02c0-4719-a8e2-1206cdb3de7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada434e584b46d9ae0cdba571e009cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:21Z,use_quota=True,user_id='f9167c0a6af8407bb70a73557f6a2529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Creating volume dd1f7d31-02c0-4719-a8e2-1206cdb3de7a {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:21 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:21 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a 1073741824 Sep 25 11:53:21 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:21 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a 1073741824" returned: 0 in 0.494s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:21 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a Sep 25 11:53:21 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:21 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a" returned: 0 in 0.276s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f45425-58fe-4891-a56e-fdceaf2c6d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5d73ad-5917-4cd8-bc28-385ecf37ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:22 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Volume volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a (dd1f7d31-02c0-4719-a8e2-1206cdb3de7a): created successfully Sep 25 11:53:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5d73ad-5917-4cd8-bc28-385ecf37ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Flow 'volume_create_manager' (dbef457e-5b4d-4d77-87d8-01d1ad7ff7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-50271032-3082-4392-a2bc-59455aed917a tempest-CinderUnicodeTest-1189963066 None] Created volume successfully. Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:23 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:23 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:23 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.330s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Flow 'volume_create_manager' (48348973-7579-4721-b110-349b8f5277f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613d7875-7244-4cf4-aab0-9c64142d6227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613d7875-7244-4cf4-aab0-9c64142d6227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2072783378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4427e249-2359-44be-8e9b-29c8fd03c339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada434e584b46d9ae0cdba571e009cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:24Z,use_quota=True,user_id='f9167c0a6af8407bb70a73557f6a2529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726118cc-c8bc-41bc-a28c-ddd80df2aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726118cc-c8bc-41bc-a28c-ddd80df2aeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5261923a-fd6f-4674-ae8f-91c7a7e4a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5261923a-fd6f-4674-ae8f-91c7a7e4a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4427e249-2359-44be-8e9b-29c8fd03c339', 'volume_name': 'volume-4427e249-2359-44be-8e9b-29c8fd03c339', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef1a2d6-b973-4b81-8ce6-0ea3237c0e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef1a2d6-b973-4b81-8ce6-0ea3237c0e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ee6beb-6504-4039-beb6-41d0085253ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:24 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Volume 4427e249-2359-44be-8e9b-29c8fd03c339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4427e249-2359-44be-8e9b-29c8fd03c339', 'volume_size': 1} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2072783378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4427e249-2359-44be-8e9b-29c8fd03c339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada434e584b46d9ae0cdba571e009cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:24Z,use_quota=True,user_id='f9167c0a6af8407bb70a73557f6a2529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Creating volume 4427e249-2359-44be-8e9b-29c8fd03c339 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:24 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:24 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 1073741824 Sep 25 11:53:24 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:24 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 1073741824" returned: 0 in 0.575s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:24 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 Sep 25 11:53:24 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:24 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339" returned: 0 in 0.304s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ee6beb-6504-4039-beb6-41d0085253ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4427e249-2359-44be-8e9b-29c8fd03c339', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:24 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b92156-c9ff-41d4-ad6a-d8f7deb4294c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:24 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Volume volume-4427e249-2359-44be-8e9b-29c8fd03c339 (4427e249-2359-44be-8e9b-29c8fd03c339): created successfully Sep 25 11:53:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b92156-c9ff-41d4-ad6a-d8f7deb4294c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:25 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Flow 'volume_create_manager' (48348973-7579-4721-b110-349b8f5277f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0df4f7b8-365a-4dc0-a934-81fda9abe38c tempest-CinderUnicodeTest-1189963066 None] Created volume successfully. Sep 25 11:53:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Creating offline snapshot 864f5221-05ab-4221-8da5-16d0ff68f517 of volume 4427e249-2359-44be-8e9b-29c8fd03c339 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:53:26 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d51f61-75fc-4540-91e4-21a0a02e9930]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:26 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 Sep 25 11:53:26 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:26 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339" returned: 0 in 0.436s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:26 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 1G Sep 25 11:53:26 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:27 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 1G" returned: 0 in 0.443s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4427e249-2359-44be-8e9b-29c8fd03c339 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:27 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4427e249-2359-44be-8e9b-29c8fd03c339 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 Sep 25 11:53:27 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:27 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4427e249-2359-44be-8e9b-29c8fd03c339 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517" returned: 0 in 0.363s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:27 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 is being set with open permissions: ugo+rw Sep 25 11:53:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:27 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 Sep 25 11:53:27 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:27 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517" returned: 0 in 0.262s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:27 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.info Sep 25 11:53:27 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:28 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.info" returned: 0 in 0.258s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:28 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.info is being set with open permissions: ugo+rw Sep 25 11:53:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:28 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.info Sep 25 11:53:28 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:28 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.info" returned: 0 in 0.272s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:28 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-251d2677-c209-4751-bf2c-f998d1d40ecd tempest-CinderUnicodeTest-1189963066 None] Create snapshot completed successfully Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "cinder-864f5221-05ab-4221-8da5-16d0ff68f517-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-864f5221-05ab-4221-8da5-16d0ff68f517-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "cinder-quobyte-4427e249-2359-44be-8e9b-29c8fd03c339" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-quobyte-4427e249-2359-44be-8e9b-29c8fd03c339" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "cinder-quobyte-864f5221-05ab-4221-8da5-16d0ff68f517" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-quobyte-864f5221-05ab-4221-8da5-16d0ff68f517" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Deleting offline snapshot 864f5221-05ab-4221-8da5-16d0ff68f517 of volume 4427e249-2359-44be-8e9b-29c8fd03c339 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] snapshot_file for this snap is: volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa70682a-e9b6-4956-a84a-adf3bef97abe]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:29 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 Sep 25 11:53:29 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:30 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517" returned: 0 in 0.426s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4427e249-2359-44be-8e9b-29c8fd03c339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:53:30 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560b8fd-01d1-4828-8c63-e540296078f9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:30 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 Sep 25 11:53:30 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:30 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339" returned: 0 in 0.514s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:30 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 Sep 25 11:53:30 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:31 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517" returned: 0 in 0.495s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:31 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517 Sep 25 11:53:31 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:31 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339.864f5221-05ab-4221-8da5-16d0ff68f517" returned: 0 in 0.311s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=123,cinder:UPDATE=171,cinder:DELETE=13,cinder:INSERT=44 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-quobyte-864f5221-05ab-4221-8da5-16d0ff68f517" released by "_delete_snapshot" :: held 1.890s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-quobyte-4427e249-2359-44be-8e9b-29c8fd03c339" released by "delete_snapshot" :: held 1.914s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Created reservations ['c565ded1-831f-47ab-a56e-619b2d817034', '94012658-e7e3-4d70-b609-7afaed4b87ab', 'ff8694f9-de64-4f5e-818d-4708cfecde01', 'e28cd29e-1a00-48bc-8c5a-d7ef6af51711'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Delete snapshot completed successfully. Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-615e3c7a-5182-43b6-ae87-b05e1d88589f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-864f5221-05ab-4221-8da5-16d0ff68f517-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "cinder-4427e249-2359-44be-8e9b-29c8fd03c339-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-4427e249-2359-44be-8e9b-29c8fd03c339-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "cinder-quobyte-4427e249-2359-44be-8e9b-29c8fd03c339" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-quobyte-4427e249-2359-44be-8e9b-29c8fd03c339" acquired by "delete_volume" :: waited 0.015s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[337af25b-e801-4415-ac9c-8cdd4ff4f596]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:31 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 Sep 25 11:53:31 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:32 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339" returned: 0 in 0.430s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:32 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339 Sep 25 11:53:32 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:32 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-4427e249-2359-44be-8e9b-29c8fd03c339" returned: 0 in 0.294s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-quobyte-4427e249-2359-44be-8e9b-29c8fd03c339" released by "delete_volume" :: held 0.804s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Created reservations ['3a9dcc39-2d0d-4a34-8307-0560ad87e82a', 'f0df987d-4aa0-488a-a30a-e03383efde75', 'b1777606-5d02-4cd0-9e71-e3e7c4ad83e6', '07ddd362-6e40-4bb7-838f-7bc8aefbbf77'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:32 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:32 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "cinder-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:32 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.277s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:32 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:33 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Deleted volume successfully. Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "cinder-quobyte-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-quobyte-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ba1768b7-550b-43c3-a0fe-926c975a877f tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-4427e249-2359-44be-8e9b-29c8fd03c339-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ba3e4-abfc-4716-9dff-16f022eb7e9e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:33 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a Sep 25 11:53:33 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:33 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a" returned: 0 in 0.397s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:33 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a Sep 25 11:53:33 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:33 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a" returned: 0 in 0.253s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-quobyte-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a" released by "delete_volume" :: held 0.697s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Created reservations ['f7f1c17b-013a-4e93-87b8-6b0b2c7ad57d', 'f4d62d5d-c783-47cd-8e16-c1202f73872c', 'c7843dff-1560-45dd-b553-bc66e5ec1477', '59f91bf6-81e5-4ada-b10c-34fadda843db'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:33 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:53:33 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:34 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.284s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:34 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Deleted volume successfully. Sep 25 11:53:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-3da06dd3-90d4-4df5-9282-08c8b4253086 tempest-CinderUnicodeTest-1189963066 None] Lock "cinder-dd1f7d31-02c0-4719-a8e2-1206cdb3de7a-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:43 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=23 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:53:44 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=159,cinder:SELECT=118,cinder:INSERT=37,cinder:DELETE=16 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (63f6042f-c326-4419-96a7-36e76673015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb1496a-48c2-42d0-957a-09d4c7cc1e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb1496a-48c2-42d0-957a-09d4c7cc1e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2005327998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e05ce9-fe00-49ba-b455-a9ef2845a89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:53Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d596fc69-c254-4cbc-aeb4-a06d99845b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d596fc69-c254-4cbc-aeb4-a06d99845b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8052d7a1-c255-4ceb-8127-ddf88d4b8670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8052d7a1-c255-4ceb-8127-ddf88d4b8670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e05ce9-fe00-49ba-b455-a9ef2845a89a', 'volume_name': 'volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4364e33-d7ea-487b-89c7-afd4afbc27f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4364e33-d7ea-487b-89c7-afd4afbc27f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01563777-5049-4e4d-894a-cc410f43afeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Volume 75e05ce9-fe00-49ba-b455-a9ef2845a89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a', 'volume_size': 1} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2005327998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e05ce9-fe00-49ba-b455-a9ef2845a89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:53Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Creating volume 75e05ce9-fe00-49ba-b455-a9ef2845a89a {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:53 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:53 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a 1073741824 Sep 25 11:53:53 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (bd041d70-df79-4f2c-94bf-12b59d6dd75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428e4fbb-949e-43a6-a685-42de442ddca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428e4fbb-949e-43a6-a685-42de442ddca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209576390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6ebfe8-715e-4fac-bf49-fe0fbd21a782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:54Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e3d20-bf1a-4c11-93f1-3f11eaf99c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e3d20-bf1a-4c11-93f1-3f11eaf99c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edba8bf-c61d-4c53-9bd4-354f292cc379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edba8bf-c61d-4c53-9bd4-354f292cc379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6ebfe8-715e-4fac-bf49-fe0fbd21a782', 'volume_name': 'volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d9afe4-8ad5-4cd0-8b8e-e84335e239a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d9afe4-8ad5-4cd0-8b8e-e84335e239a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483407ee-939e-4ba6-a1b1-ebad72d94d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:53 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume 0c6ebfe8-715e-4fac-bf49-fe0fbd21a782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782', 'volume_size': 1} Sep 25 11:53:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (9f34de3f-0deb-4f1c-b037-abd9233dd77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2fd740-0840-4362-baf2-b8861c6271be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2fd740-0840-4362-baf2-b8861c6271be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-228093248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be27bd1-e5d1-436b-8527-b045b02dfe96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:54Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c36c5-f273-426b-8b8c-0445ee837fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c36c5-f273-426b-8b8c-0445ee837fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda90f3e-213c-48d6-8bac-e65ef685761a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda90f3e-213c-48d6-8bac-e65ef685761a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be27bd1-e5d1-436b-8527-b045b02dfe96', 'volume_name': 'volume-0be27bd1-e5d1-436b-8527-b045b02dfe96', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72c13e1-4d47-49ad-a504-df8488f69b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72c13e1-4d47-49ad-a504-df8488f69b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12597250-6fe6-4146-ab4a-858c4982c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Volume 0be27bd1-e5d1-436b-8527-b045b02dfe96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be27bd1-e5d1-436b-8527-b045b02dfe96', 'volume_size': 1} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:54 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (80316817-8e8d-4ab2-9411-095b1bf4d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf60fd7a-e139-4208-b39f-46f70feb732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a 1073741824" returned: 0 in 1.033s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf60fd7a-e139-4208-b39f-46f70feb732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-328132160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993fdfb0-50d2-4a78-802b-54c2dac1eddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:54Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1169fa-8bd0-439a-a5fc-827dda0188f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1169fa-8bd0-439a-a5fc-827dda0188f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb027805-0354-4a0d-982f-5b82ee6bc2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb027805-0354-4a0d-982f-5b82ee6bc2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993fdfb0-50d2-4a78-802b-54c2dac1eddc', 'volume_name': 'volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59468617-9554-4d57-8a54-718a8521d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59468617-9554-4d57-8a54-718a8521d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0563dc28-b693-4e02-b491-a39fe1794837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:54 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Volume 993fdfb0-50d2-4a78-802b-54c2dac1eddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc', 'volume_size': 1} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:54 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a Sep 25 11:53:54 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:55 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a" returned: 0 in 0.394s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209576390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6ebfe8-715e-4fac-bf49-fe0fbd21a782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:54Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Creating volume 0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:55 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01563777-5049-4e4d-894a-cc410f43afeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a064f1f6-8cd6-437d-9757-e46394b9cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:55 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 1073741824 Sep 25 11:53:55 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:55 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Volume volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a (75e05ce9-fe00-49ba-b455-a9ef2845a89a): created successfully Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a064f1f6-8cd6-437d-9757-e46394b9cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (63f6042f-c326-4419-96a7-36e76673015e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1361fb04-e7ed-4f04-ad6a-f647c258773d tempest-CreateVolumesFromImageTest-1586856072 None] Created volume successfully. Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (4ef4b3b5-8c1c-4379-bbdc-309b89505fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f16ae7b-69e1-4580-9b63-0e2af96acd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f16ae7b-69e1-4580-9b63-0e2af96acd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193345880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407cc748-1cda-4ace-ba3b-506e8be14d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:56Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547da89f-0acb-4c1b-bf79-1e7c21d6c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547da89f-0acb-4c1b-bf79-1e7c21d6c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48075e89-6644-4636-bdb0-2f8e51e4c7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48075e89-6644-4636-bdb0-2f8e51e4c7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407cc748-1cda-4ace-ba3b-506e8be14d6d', 'volume_name': 'volume-407cc748-1cda-4ace-ba3b-506e8be14d6d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e10dc8-2a14-489b-8a66-cd1e99eebcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e10dc8-2a14-489b-8a66-cd1e99eebcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7a6acd-8c2e-41d4-aea0-b57c291c01c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:55 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Volume 407cc748-1cda-4ace-ba3b-506e8be14d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407cc748-1cda-4ace-ba3b-506e8be14d6d', 'volume_size': 1} Sep 25 11:53:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:56 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (63fdd25a-595f-41af-afb3-8939d96911a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575b3939-2f8a-4e52-9fba-77d155c87930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 1073741824" returned: 0 in 0.929s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575b3939-2f8a-4e52-9fba-77d155c87930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1550804574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:56Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece3e36c-079f-4444-8e42-23a4b9d246dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece3e36c-079f-4444-8e42-23a4b9d246dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db485a6e-c2ea-4fed-a2a3-deeca9717e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db485a6e-c2ea-4fed-a2a3-deeca9717e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12', 'volume_name': 'volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dfd645-6cb8-4895-a752-212fccc09ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dfd645-6cb8-4895-a752-212fccc09ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3044481-30cd-4dc5-932a-f23d5725d937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:56 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Volume 1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12', 'volume_size': 1} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:56 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 Sep 25 11:53:56 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:56 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782" returned: 0 in 0.335s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.357s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-228093248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be27bd1-e5d1-436b-8527-b045b02dfe96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:54Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Creating volume 0be27bd1-e5d1-436b-8527-b045b02dfe96 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:56 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:56 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 1073741824 Sep 25 11:53:56 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483407ee-939e-4ba6-a1b1-ebad72d94d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e62d4a6-9dad-4e70-9eb2-7e57f2d53d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:56 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 (0c6ebfe8-715e-4fac-bf49-fe0fbd21a782): created successfully Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e62d4a6-9dad-4e70-9eb2-7e57f2d53d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:56 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (bd041d70-df79-4f2c-94bf-12b59d6dd75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:56 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-818c0928-5b1a-4d25-987b-7a3b810b2946 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created volume successfully. Sep 25 11:53:57 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 1073741824" returned: 0 in 0.693s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:57 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 Sep 25 11:53:57 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:57 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96" returned: 0 in 0.369s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-328132160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993fdfb0-50d2-4a78-802b-54c2dac1eddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:54Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Creating volume 993fdfb0-50d2-4a78-802b-54c2dac1eddc {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:57 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:57 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc 1073741824 Sep 25 11:53:57 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12597250-6fe6-4146-ab4a-858c4982c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be27bd1-e5d1-436b-8527-b045b02dfe96', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a139d669-1de9-4bc2-b5b6-a538eb387eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:57 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Volume volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 (0be27bd1-e5d1-436b-8527-b045b02dfe96): created successfully Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a139d669-1de9-4bc2-b5b6-a538eb387eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:57 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (9f34de3f-0deb-4f1c-b037-abd9233dd77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c4d0c947-6469-43b5-8c67-6a7fd5b5ea4d tempest-CreateVolumesFromImageTest-1586856072 None] Created volume successfully. Sep 25 11:53:58 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc 1073741824" returned: 0 in 0.764s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:58 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc Sep 25 11:53:58 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (6c055813-964e-4321-b085-fdcb3cc1e256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9692a0-ed8d-4692-8922-2125490ab207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9692a0-ed8d-4692-8922-2125490ab207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645608802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812cf3d7-f6f1-4c86-bc8d-42af68af3376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:59Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8b86c4-62b9-4057-804a-3b8017e4946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8b86c4-62b9-4057-804a-3b8017e4946e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e17679-6ca3-499f-90e6-80c01474176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e17679-6ca3-499f-90e6-80c01474176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812cf3d7-f6f1-4c86-bc8d-42af68af3376', 'volume_name': 'volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636f85fe-0439-4611-ab02-b1f3144e3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636f85fe-0439-4611-ab02-b1f3144e3e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db6b836-8b01-46f4-8591-ba53b4ebff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:58 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume 812cf3d7-f6f1-4c86-bc8d-42af68af3376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376', 'volume_size': 1} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:58 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc" returned: 0 in 0.318s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.981s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193345880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407cc748-1cda-4ace-ba3b-506e8be14d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:56Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Creating volume 407cc748-1cda-4ace-ba3b-506e8be14d6d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:58 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:58 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d 1073741824 Sep 25 11:53:58 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0563dc28-b693-4e02-b491-a39fe1794837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d3ad03-ee9a-4085-af17-9f7d0082a221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:58 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Volume volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc (993fdfb0-50d2-4a78-802b-54c2dac1eddc): created successfully Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d3ad03-ee9a-4085-af17-9f7d0082a221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:58 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (80316817-8e8d-4ab2-9411-095b1bf4d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-cc8d6b3a-ff06-4662-9a8e-5c3400fbf67c tempest-CreateVolumesFromImageTest-1586856072 None] Created volume successfully. Sep 25 11:53:59 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d 1073741824" returned: 0 in 0.747s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:59 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d Sep 25 11:53:59 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (2467972c-fba9-4f87-a492-b410b6d92910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d752368-3d93-4e2e-9f01-57e9203353d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d752368-3d93-4e2e-9f01-57e9203353d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031283268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:00Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d0354c-3cb2-433f-a8bc-a2995ed2cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d0354c-3cb2-433f-a8bc-a2995ed2cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce068e24-5a17-4824-a92c-655a28240363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:59 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce068e24-5a17-4824-a92c-655a28240363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f', 'volume_name': 'volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa49d3a1-483d-44b8-bfaf-21a052100a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa49d3a1-483d-44b8-bfaf-21a052100a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab35431-1f7d-4f07-bef7-b3115c51e7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume 1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f', 'volume_size': 1} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:00 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Flow 'volume_create_manager' (b8403a72-9e02-4177-889a-cc803baa5f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d11054-4dcf-4673-984f-b5e5c23779fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d" returned: 0 in 0.565s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1550804574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688c3a26c91a45f881e02fd7a1038ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:56Z,use_quota=True,user_id='1de7dfc6dd754c1fb6f0e4b45f011254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Creating volume 1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:00 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d11054-4dcf-4673-984f-b5e5c23779fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4bf3d0185243e7b2ef5a4d961fd93a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:00Z,use_quota=True,user_id='eb29b35d889a4faaaf91e6cf5addcd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(070e1c3b-a2bd-4bb9-9366-c140f32668e0),volume_type_id=070e1c3b-a2bd-4bb9-9366-c140f32668e0)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed7a5d4-a114-4b7d-93b3-731621b7ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed7a5d4-a114-4b7d-93b3-731621b7ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 1073741824 Sep 25 11:54:00 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c373dfb0-2c00-4834-b893-b6e02b7b2a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7a6acd-8c2e-41d4-aea0-b57c291c01c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407cc748-1cda-4ace-ba3b-506e8be14d6d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d34ea1-8267-4a9a-b851-514a61fafd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (88c2bcbb-e073-43fa-9845-79c7d98eecf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed6ac9d-af34-4127-a1c5-44878a29fab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed6ac9d-af34-4127-a1c5-44878a29fab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1363341403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9a1291-a99c-4152-aec8-0d1d36a80524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:00Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267a3746-cfe9-4743-be4c-eb3c94dfcb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267a3746-cfe9-4743-be4c-eb3c94dfcb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b6bd34-4ec2-4551-8ef8-51b4b91e66d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b6bd34-4ec2-4551-8ef8-51b4b91e66d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae9a1291-a99c-4152-aec8-0d1d36a80524', 'volume_name': 'volume-ae9a1291-a99c-4152-aec8-0d1d36a80524', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb340cc7-94fa-43e3-806a-da2b0f6f7cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb340cc7-94fa-43e3-806a-da2b0f6f7cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11578532-2acf-4f64-a4c0-e700504d5eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume ae9a1291-a99c-4152-aec8-0d1d36a80524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae9a1291-a99c-4152-aec8-0d1d36a80524', 'volume_size': 1} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Volume volume-407cc748-1cda-4ace-ba3b-506e8be14d6d (407cc748-1cda-4ace-ba3b-506e8be14d6d): created successfully Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d34ea1-8267-4a9a-b851-514a61fafd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (4ef4b3b5-8c1c-4379-bbdc-309b89505fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:00 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4537d7c6-4b7c-4fa3-aa88-57ce61f3ccb9 tempest-CreateVolumesFromImageTest-1586856072 None] Created volume successfully. Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (92c7b06a-8e67-4fba-95f2-34f20a884eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6b2e64-b8e8-40ad-a283-2963fe5aad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6b2e64-b8e8-40ad-a283-2963fe5aad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445904152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e652b1-014a-4065-8295-49b785857d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:01Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7bf2e9-3bc0-4964-bc08-31567cbea620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7bf2e9-3bc0-4964-bc08-31567cbea620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084a402d-c07c-400b-bcff-5c4fd17d427c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084a402d-c07c-400b-bcff-5c4fd17d427c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e652b1-014a-4065-8295-49b785857d32', 'volume_name': 'volume-02e652b1-014a-4065-8295-49b785857d32', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1655ea5-1a46-44c8-ab35-0ccb129a46ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1655ea5-1a46-44c8-ab35-0ccb129a46ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1520bfe-6f41-4496-b855-c94936637b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume 02e652b1-014a-4065-8295-49b785857d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e652b1-014a-4065-8295-49b785857d32', 'volume_size': 1} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c373dfb0-2c00-4834-b893-b6e02b7b2a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7', 'volume_name': 'volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7', 'volume_size': 1, 'image_id': 'd80bfec0-8be4-45c4-8137-67f3b48b8b02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da128292a6ffe755333dd0a478a17e6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c4bf3d0185243e7b2ef5a4d961fd93a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14311af80f2530e590d100b3496d037111091a9fb28de08d1e88822e7b67e9a4f1ae03bf645dce082feac7efcbeeff436502f9388c99e16fb981bba98e6ba2cf', 'id': 'd80bfec0-8be4-45c4-8137-67f3b48b8b02', 'created_at': datetime.datetime(2026, 9, 25, 9, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f2671c-9ceb-4ad2-bc58-df3ee68fc9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f2671c-9ceb-4ad2-bc58-df3ee68fc9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc9a7a0-11b0-4d22-8e89-3ba6da31d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Volume bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7', 'volume_size': 1, 'image_id': 'd80bfec0-8be4-45c4-8137-67f3b48b8b02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da128292a6ffe755333dd0a478a17e6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c4bf3d0185243e7b2ef5a4d961fd93a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14311af80f2530e590d100b3496d037111091a9fb28de08d1e88822e7b67e9a4f1ae03bf645dce082feac7efcbeeff436502f9388c99e16fb981bba98e6ba2cf', 'id': 'd80bfec0-8be4-45c4-8137-67f3b48b8b02', 'created_at': datetime.datetime(2026, 9, 25, 9, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Trying to clone bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 from image d80bfec0-8be4-45c4-8137-67f3b48b8b02 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 1073741824" returned: 0 in 0.890s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:01 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 Sep 25 11:54:01 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:54:01 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Image download 0.00 MB at 0.00 MB/s Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c48870-d9a8-4389-b509-adeeccfbbe2c]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:01 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD Sep 25 11:54:01 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (71791118-8bbb-4e67-9815-c27bec09878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07edab2a-813f-4648-861d-18f9720a9c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12" returned: 0 in 0.357s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.852s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645608802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812cf3d7-f6f1-4c86-bc8d-42af68af3376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:59Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Creating volume 812cf3d7-f6f1-4c86-bc8d-42af68af3376 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:01 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07edab2a-813f-4648-861d-18f9720a9c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076125505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8571a17d-9f1c-4e9d-b526-5c9f745dd17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:01Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63ef563-7f8f-4547-89a9-b9f334c39f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 1073741824 Sep 25 11:54:01 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63ef563-7f8f-4547-89a9-b9f334c39f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b9fbe6-93db-486d-b4d3-be0ff23ede15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b9fbe6-93db-486d-b4d3-be0ff23ede15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8571a17d-9f1c-4e9d-b526-5c9f745dd17a', 'volume_name': 'volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36310b59-c0c2-4466-888d-8223ca6dc0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36310b59-c0c2-4466-888d-8223ca6dc0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b8abee-51d0-497a-83e2-d1ea64361dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume 8571a17d-9f1c-4e9d-b526-5c9f745dd17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a', 'volume_size': 1} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3044481-30cd-4dc5-932a-f23d5725d937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7dc866-eb84-4adb-b621-2f4211a21adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Volume volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 (1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12): created successfully Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7dc866-eb84-4adb-b621-2f4211a21adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Flow 'volume_create_manager' (63fdd25a-595f-41af-afb3-8939d96911a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:01 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-820e9294-cb8d-4df6-ac46-f00f98fb5dec tempest-CreateVolumesFromImageTest-1586856072 None] Created volume successfully. Sep 25 11:54:01 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:02 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD Sep 25 11:54:02 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:02 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 1073741824" returned: 0 in 0.687s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:02 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 Sep 25 11:54:02 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:02 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD" returned: 1 in 0.565s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Temporary image d80bfec0-8be4-45c4-8137-67f3b48b8b02 is fetched for user eb29b35d889a4faaaf91e6cf5addcd88. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-quobyte-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12" acquired by "delete_volume" :: waited 0.044s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a8fc7-bf42-4ff1-a102-8f7e9e029daa]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8771333f-2281-480f-9a25-31fff66e8d6e]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:02 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 Sep 25 11:54:02 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:02 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376" returned: 0 in 0.369s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.676s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031283268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:00Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Creating volume 1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:02 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD Sep 25 11:54:02 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:02 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db6b836-8b01-46f4-8591-ba53b4ebff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:02 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f 1073741824 Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef5148b-7c4d-4f19-9715-e086828b3c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:02 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:02 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 (812cf3d7-f6f1-4c86-bc8d-42af68af3376): created successfully Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef5148b-7c4d-4f19-9715-e086828b3c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:02 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (6c055813-964e-4321-b085-fdcb3cc1e256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:02 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2fae0d7f-711c-483d-b4c1-5da53083cebf tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created volume successfully. Sep 25 11:54:03 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12" returned: 0 in 0.518s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:03 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12 Sep 25 11:54:03 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:03 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD" returned: 0 in 0.611s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:03 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD Sep 25 11:54:03 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:03 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f 1073741824" returned: 0 in 0.799s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:03 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12" returned: 0 in 0.522s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12" released by "delete_volume" :: held 1.111s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:03 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f Sep 25 11:54:03 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Created reservations ['11aca052-a9eb-40e7-b50d-cf4b9ff1bb15', '6728c08c-6563-4f02-9f85-251f2d964909', '910a0162-b433-419f-b796-acebbb33208c', '0775f243-fda1-48de-b06b-8311a2d82146'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:03 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD" returned: 1 in 0.576s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:03 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:03 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:03 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.403s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1363341403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9a1291-a99c-4152-aec8-0d1d36a80524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:00Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Creating volume ae9a1291-a99c-4152-aec8-0d1d36a80524 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:03 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab35431-1f7d-4f07-bef7-b3115c51e7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be931a0a-08b2-408f-bbf1-c6011ddbfce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:04 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 1073741824 Sep 25 11:54:04 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:04 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f (1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f): created successfully Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be931a0a-08b2-408f-bbf1-c6011ddbfce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (2467972c-fba9-4f87-a492-b410b6d92910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0c56f5b2-57c2-4110-95d2-b8187691b3e1 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created volume successfully. Sep 25 11:54:04 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.343s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Deleted volume successfully. Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da6c023a-d5e0-4fbd-a6a2-1781ca0ec71a tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-1e26ca1b-7bf2-4eac-98c8-65d89a3c1f12-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-407cc748-1cda-4ace-ba3b-506e8be14d6d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:04 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-407cc748-1cda-4ace-ba3b-506e8be14d6d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 1073741824" returned: 0 in 0.739s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-quobyte-407cc748-1cda-4ace-ba3b-506e8be14d6d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:04 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 Sep 25 11:54:04 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-407cc748-1cda-4ace-ba3b-506e8be14d6d" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2271c0-36d0-4434-a806-bdf73665bc10]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:05 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d Sep 25 11:54:05 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:05 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524" returned: 0 in 0.439s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.112s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445904152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e652b1-014a-4065-8295-49b785857d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:01Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Creating volume 02e652b1-014a-4065-8295-49b785857d32 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:05 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11578532-2acf-4f64-a4c0-e700504d5eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae9a1291-a99c-4152-aec8-0d1d36a80524', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:05 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 1073741824 Sep 25 11:54:05 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016024de-e23b-41b4-a832-1a2f5cd90217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:05 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 (ae9a1291-a99c-4152-aec8-0d1d36a80524): created successfully Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016024de-e23b-41b4-a832-1a2f5cd90217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (88c2bcbb-e073-43fa-9845-79c7d98eecf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:05 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f03a1f36-b3ed-47a7-9725-c8d79808d158 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created volume successfully. Sep 25 11:54:05 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d" returned: 0 in 0.592s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:05 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d Sep 25 11:54:05 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:05 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-407cc748-1cda-4ace-ba3b-506e8be14d6d" returned: 0 in 0.274s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-407cc748-1cda-4ace-ba3b-506e8be14d6d" released by "delete_volume" :: held 0.924s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Created reservations ['c0f50cad-05d4-4047-b8db-a312801052d8', '9162d563-836f-4b1b-bade-f3aa5518fe6d', '75ad0255-331b-42f9-8682-7c3d9ffc1f67', '70c464a7-ce82-4f3a-866a-848568ef7f1b'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:05 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 1073741824" returned: 0 in 0.727s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:05 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:06 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 Sep 25 11:54:06 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:06 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.373s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:06 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Deleted volume successfully. Sep 25 11:54:06 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-89ec6f08-90ef-4f58-93ce-60f90a337bc1 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-407cc748-1cda-4ace-ba3b-506e8be14d6d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32" returned: 0 in 0.365s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.746s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076125505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8571a17d-9f1c-4e9d-b526-5c9f745dd17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770e2d6454cc422e96933ebd98a2a908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:01Z,use_quota=True,user_id='f9d937d3950b471393c275166fa02d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Creating volume 8571a17d-9f1c-4e9d-b526-5c9f745dd17a {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:06 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1520bfe-6f41-4496-b855-c94936637b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e652b1-014a-4065-8295-49b785857d32', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:06 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a 1073741824 Sep 25 11:54:06 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a892f7bb-39f2-41bb-9a11-96816f0e102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:06 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume volume-02e652b1-014a-4065-8295-49b785857d32 (02e652b1-014a-4065-8295-49b785857d32): created successfully Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a892f7bb-39f2-41bb-9a11-96816f0e102c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (92c7b06a-8e67-4fba-95f2-34f20a884eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:06 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ef8ed611-b220-44ef-be89-78e802170fd3 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created volume successfully. Sep 25 11:54:06 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a 1073741824" returned: 0 in 0.593s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-993fdfb0-50d2-4a78-802b-54c2dac1eddc-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:07 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a Sep 25 11:54:07 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-993fdfb0-50d2-4a78-802b-54c2dac1eddc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-quobyte-993fdfb0-50d2-4a78-802b-54c2dac1eddc" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-993fdfb0-50d2-4a78-802b-54c2dac1eddc" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be3e96-07bb-4dd2-acc0-35a5e1d8413f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:07 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc Sep 25 11:54:07 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:07 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a" returned: 0 in 0.367s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.663s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4bf3d0185243e7b2ef5a4d961fd93a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:00Z,use_quota=True,user_id='eb29b35d889a4faaaf91e6cf5addcd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(070e1c3b-a2bd-4bb9-9366-c140f32668e0),volume_type_id=070e1c3b-a2bd-4bb9-9366-c140f32668e0)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Creating volume bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:07 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:07 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 1073741824 Sep 25 11:54:07 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b8abee-51d0-497a-83e2-d1ea64361dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b117f8f5-6e63-426f-adc6-59a56ed93847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:07 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Volume volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a (8571a17d-9f1c-4e9d-b526-5c9f745dd17a): created successfully Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b117f8f5-6e63-426f-adc6-59a56ed93847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Flow 'volume_create_manager' (71791118-8bbb-4e67-9815-c27bec09878d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f3eb2b4f-4914-4b2c-8c9a-adf22ed74f68 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created volume successfully. Sep 25 11:54:07 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc" returned: 0 in 0.502s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:07 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc Sep 25 11:54:07 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:08 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 1073741824" returned: 0 in 0.613s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:08 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-993fdfb0-50d2-4a78-802b-54c2dac1eddc" returned: 0 in 0.398s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:08 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 Sep 25 11:54:08 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-993fdfb0-50d2-4a78-802b-54c2dac1eddc" released by "delete_volume" :: held 0.968s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Created reservations ['8d89eaac-a678-461c-8fc9-f8753e76f41d', '04637f5b-68ab-4312-a0c3-e4f89ab8ea5b', '081df121-86eb-4133-9481-0de140cb22da', 'c93143ad-d178-4a08-87e2-32cb53465f68'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-8571a17d-9f1c-4e9d-b526-5c9f745dd17a-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-8571a17d-9f1c-4e9d-b526-5c9f745dd17a-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:08 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7" returned: 0 in 0.395s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-quobyte-8571a17d-9f1c-4e9d-b526-5c9f745dd17a" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Attempting download of d80bfec0-8be4-45c4-8137-67f3b48b8b02 ((None, [{'url': 'file:///opt/stack/data/glance/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02', 'metadata': {}}])) to volume bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-8571a17d-9f1c-4e9d-b526-5c9f745dd17a" acquired by "delete_volume" :: waited 0.050s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:08 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:08 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d06607-b95f-4132-8e02-f13c06dbb027]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[927633a0-7b85-42a1-bfde-7f5bedb0e432]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d80bfec0-8be4-45c4-8137-67f3b48b8b02_mwfpyr29 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:08 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a Sep 25 11:54:08 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:08 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d80bfec0-8be4-45c4-8137-67f3b48b8b02_mwfpyr29 Sep 25 11:54:08 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:08 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.345s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:08 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Deleted volume successfully. Sep 25 11:54:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d0f5bb0d-2305-4409-ba62-9de593f6ba6b tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-993fdfb0-50d2-4a78-802b-54c2dac1eddc-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:09 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a" returned: 0 in 0.428s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:09 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d80bfec0-8be4-45c4-8137-67f3b48b8b02_mwfpyr29" returned: 0 in 0.414s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d80bfec0-8be4-45c4-8137-67f3b48b8b02_mwfpyr29 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:09 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a Sep 25 11:54:09 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:09 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d80bfec0-8be4-45c4-8137-67f3b48b8b02_mwfpyr29 Sep 25 11:54:09 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:09 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8571a17d-9f1c-4e9d-b526-5c9f745dd17a" returned: 0 in 0.286s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-8571a17d-9f1c-4e9d-b526-5c9f745dd17a" released by "delete_volume" :: held 0.775s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created reservations ['e21968d7-2b5b-44df-b50a-f2e00e19a17f', '418e9653-d857-461a-97c6-777d829bfb7c', '5f8b2e44-4e33-4185-ac0c-36b8f6317268', 'c5b42ed8-8aec-4520-9484-7bd7d22c820d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:09 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d80bfec0-8be4-45c4-8137-67f3b48b8b02_mwfpyr29" returned: 1 in 0.402s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d80bfec0-8be4-45c4-8137-67f3b48b8b02_mwfpyr29' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da3b674-9b88-4570-8649-44d556b5d8df]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-0be27bd1-e5d1-436b-8527-b045b02dfe96-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:09 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:09 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-0be27bd1-e5d1-436b-8527-b045b02dfe96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:09 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD Sep 25 11:54:09 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-02e652b1-014a-4065-8295-49b785857d32-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-02e652b1-014a-4065-8295-49b785857d32-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-quobyte-0be27bd1-e5d1-436b-8527-b045b02dfe96" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-0be27bd1-e5d1-436b-8527-b045b02dfe96" acquired by "delete_volume" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-quobyte-02e652b1-014a-4065-8295-49b785857d32" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5405e558-44b5-4e19-9f08-b71a6d7f00d4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-02e652b1-014a-4065-8295-49b785857d32" acquired by "delete_volume" :: waited 0.047s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa366e1-19f3-4ff7-9fc3-317e259e39b2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 Sep 25 11:54:10 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD" returned: 0 in 0.583s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.483s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Deleted volume successfully. Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-161f4bf8-28eb-4643-a4b7-362b7fab2f80 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-8571a17d-9f1c-4e9d-b526-5c9f745dd17a-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:10 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 Sep 25 11:54:10 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD Sep 25 11:54:10 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96" returned: 0 in 0.608s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96 Sep 25 11:54:10 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD" returned: 1 in 0.555s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] d80bfec0-8be4-45c4-8137-67f3b48b8b02 was raw, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:54:10 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32" returned: 0 in 0.671s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 Sep 25 11:54:10 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32 Sep 25 11:54:10 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0be27bd1-e5d1-436b-8527-b045b02dfe96" returned: 0 in 0.345s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-0be27bd1-e5d1-436b-8527-b045b02dfe96" released by "delete_volume" :: held 1.080s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Created reservations ['90d09fb0-d403-46e5-b7ca-09a2efd813ea', '0dd70faf-29e9-4680-8e4c-a43675bcd637', 'cd6f5779-9846-429c-a369-4566305dcccf', '5829fcc2-c722-40f1-83ce-157c8c85c1d8'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:11 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-02e652b1-014a-4065-8295-49b785857d32" returned: 0 in 0.414s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-02e652b1-014a-4065-8295-49b785857d32" released by "delete_volume" :: held 1.183s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:11 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:11 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created reservations ['f438fb76-14fc-4c3d-8e6a-e953768f6071', '3d8af7eb-c94c-4821-bcb9-455bae298d74', '7498aa08-6ed3-4a80-bd3d-de5d60e961ff', '082d0928-9a8b-451f-b368-f564268e826c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:11 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:11 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:11 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7" returned: 0 in 0.842s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d80bfec0-8be4-45c4-8137-67f3b48b8b02_69hvrlp_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:54:11 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:11 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 1G Sep 25 11:54:11 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:11 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.426s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Deleted volume successfully. Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c643dfb0-13f7-4ab2-af59-1d516da7c954 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-0be27bd1-e5d1-436b-8527-b045b02dfe96-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:11 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.307s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:11 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Deleted volume successfully. Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1d994d5b-48f3-4aae-9237-33313741babb tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-02e652b1-014a-4065-8295-49b785857d32-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:11 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 1G" returned: 0 in 0.394s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Downloaded image d80bfec0-8be4-45c4-8137-67f3b48b8b02 ((None, [{'url': 'file:///opt/stack/data/glance/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02', 'metadata': {}}])) to volume bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Temporary image d80bfec0-8be4-45c4-8137-67f3b48b8b02 for user eb29b35d889a4faaaf91e6cf5addcd88 is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Marking volume bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Copying metadata from image d80bfec0-8be4-45c4-8137-67f3b48b8b02 to bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Creating volume glance metadata for volume bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 backed by image d80bfec0-8be4-45c4-8137-67f3b48b8b02 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd80bfec0-8be4-45c4-8137-67f3b48b8b02', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'da128292a6ffe755333dd0a478a17e6f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc9a7a0-11b0-4d22-8e89-3ba6da31d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7', 'volume_size': 1, 'image_id': 'd80bfec0-8be4-45c4-8137-67f3b48b8b02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da128292a6ffe755333dd0a478a17e6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c4bf3d0185243e7b2ef5a4d961fd93a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14311af80f2530e590d100b3496d037111091a9fb28de08d1e88822e7b67e9a4f1ae03bf645dce082feac7efcbeeff436502f9388c99e16fb981bba98e6ba2cf', 'id': 'd80bfec0-8be4-45c4-8137-67f3b48b8b02', 'created_at': datetime.datetime(2026, 9, 25, 9, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d80bfec0-8be4-45c4-8137-67f3b48b8b02/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93bca14-7b21-4038-82d6-de088612c087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:12 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Volume volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 (bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7): created successfully Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93bca14-7b21-4038-82d6-de088612c087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Flow 'volume_create_manager' (b8403a72-9e02-4177-889a-cc803baa5f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:12 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-50a0e437-81b6-4f65-be49-b8c9e139344b tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Created volume successfully. Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-75e05ce9-fe00-49ba-b455-a9ef2845a89a-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-75e05ce9-fe00-49ba-b455-a9ef2845a89a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "cinder-quobyte-75e05ce9-fe00-49ba-b455-a9ef2845a89a" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-75e05ce9-fe00-49ba-b455-a9ef2845a89a" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc584e4-411c-40db-a065-a71fdcaf383d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-ae9a1291-a99c-4152-aec8-0d1d36a80524-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-ae9a1291-a99c-4152-aec8-0d1d36a80524-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-quobyte-ae9a1291-a99c-4152-aec8-0d1d36a80524" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-ae9a1291-a99c-4152-aec8-0d1d36a80524" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cdba84-6342-4851-b06a-f181c22a0d7e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:12 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a Sep 25 11:54:12 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:12 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 Sep 25 11:54:12 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:12 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a" returned: 0 in 0.584s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:12 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a Sep 25 11:54:12 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:13 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524" returned: 0 in 0.586s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:13 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524 Sep 25 11:54:13 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Acquiring lock "cinder-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:13 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-75e05ce9-fe00-49ba-b455-a9ef2845a89a" returned: 0 in 0.476s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "cinder-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-quobyte-75e05ce9-fe00-49ba-b455-a9ef2845a89a" released by "delete_volume" :: held 1.158s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Acquiring lock "cinder-quobyte-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "cinder-quobyte-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e1579a-8911-45fb-8810-3d6ab0579947]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Created reservations ['832f1ac7-5056-456b-8661-14e2e7920836', 'b836effb-2065-42d2-940e-b2fc51319887', '8bb063b3-e40f-4534-9f2d-6be6bc01d8a0', 'f018ed01-e79f-424e-8a8c-8bb481bf0a02'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:13 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-ae9a1291-a99c-4152-aec8-0d1d36a80524" returned: 0 in 0.466s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-ae9a1291-a99c-4152-aec8-0d1d36a80524" released by "delete_volume" :: held 1.116s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:13 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 Sep 25 11:54:13 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:13 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:13 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created reservations ['a0280c5f-2917-41a2-a7ec-8ba6b4491ba4', '6d7344f8-e545-4d12-9717-dd1ac0b9404b', 'c0becfe3-81c9-4b9e-91af-bd92947759be', '459d75b1-7dae-41bc-b456-50f43bd877d9'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:13 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:13 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:14 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7" returned: 0 in 0.514s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:14 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.383s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Deleted volume successfully. Sep 25 11:54:14 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7 Sep 25 11:54:14 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-59d8220f-e7d7-41a8-8bc1-de8a07ad89d3 tempest-CreateVolumesFromImageTest-1586856072 None] Lock "cinder-75e05ce9-fe00-49ba-b455-a9ef2845a89a-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:14 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.359s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Deleted volume successfully. Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-6a4ad0a1-6618-40e4-88e8-b67b017a6af8 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-ae9a1291-a99c-4152-aec8-0d1d36a80524-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:14 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7" returned: 0 in 0.375s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "cinder-quobyte-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7" released by "delete_volume" :: held 0.969s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Created reservations ['7c2475f7-948f-4ef4-8072-97ef79786305', '374d05d1-f452-49d4-b9ad-9ddba1cedd31', 'd7f5b60e-39fd-4217-a7ce-646a460615b2', 'e3a05c6d-6661-4b24-85ee-affa057bc4a3'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:14 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:14 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-quobyte-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f" acquired by "delete_volume" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eac2db-fa90-406b-bf34-b3873c809132]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:15 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f Sep 25 11:54:15 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:15 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.430s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:15 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Deleted volume successfully. Sep 25 11:54:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-11b33fe1-eb5f-4d5b-90e6-f23064d184c8 tempest-VolumeAndVolumeTypeFromImageTest-2066452711 None] Lock "cinder-bd0aa05d-9783-4984-b56f-1a4a5fbc0bd7-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:15 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f" returned: 0 in 0.517s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:15 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f Sep 25 11:54:15 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:15 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f" returned: 0 in 0.369s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f" released by "delete_volume" :: held 0.973s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created reservations ['6d0a1777-7a2c-4b43-bddd-0bc1e3f78bd3', 'b4537670-9d4c-4c7c-b85f-4bb2e7a3ee03', 'bd63e7fa-e5ac-44aa-a3a8-43af32bf4c09', 'f88792e0-7383-491c-aa26-1f2952287726'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:16 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:16 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:16 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.532s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Deleted volume successfully. Sep 25 11:54:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8709db66-32d1-4fe7-875c-8d5463be9cd4 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-1d5f1071-dcbd-4b5f-a77d-8b07e6d3c68f-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-812cf3d7-f6f1-4c86-bc8d-42af68af3376-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-812cf3d7-f6f1-4c86-bc8d-42af68af3376-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-quobyte-812cf3d7-f6f1-4c86-bc8d-42af68af3376" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-812cf3d7-f6f1-4c86-bc8d-42af68af3376" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:17 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3436e4-3500-438d-99a6-fb495ee7edb2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:17 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 Sep 25 11:54:17 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:17 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376" returned: 0 in 0.452s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:17 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376 Sep 25 11:54:17 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:18 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-812cf3d7-f6f1-4c86-bc8d-42af68af3376" returned: 0 in 0.377s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-812cf3d7-f6f1-4c86-bc8d-42af68af3376" released by "delete_volume" :: held 0.906s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created reservations ['c0e67233-beee-4a79-90c1-be0b910194ae', '7a434e19-d625-440f-9b70-ca6d3fea4c4c', 'f2f4ff4a-7d9f-461f-a931-b013fda6f6ff', '331c3077-46df-40d6-b34d-e56ec0bb2d98'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:18 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:18 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "cinder-quobyte-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:18 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.415s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:18 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Deleted volume successfully. Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[907d70a4-b057-49fa-8a8d-be5770c2d277]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-32f66464-2db8-4ccf-bc48-f8a75aaac2e0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-812cf3d7-f6f1-4c86-bc8d-42af68af3376-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:19 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 Sep 25 11:54:19 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:19 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782" returned: 0 in 0.636s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:19 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782 Sep 25 11:54:19 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:19 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782" returned: 0 in 0.395s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-quobyte-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782" released by "delete_volume" :: held 1.134s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:19 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Created reservations ['d8e19312-9bda-4226-bf5c-0d7cfaf5056c', '7f6af651-3334-4606-9450-11c530bc9fd2', 'ac84ae4b-2e6e-4cd4-b63b-c5563aa22c53', '6dce064f-18c8-4075-9801-2c60271cdfe4'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (46bff03f-cc50-4607-ad10-30303f5812e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bd2c7f-b1e1-40d7-b53b-f9b36a7e0baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bd2c7f-b1e1-40d7-b53b-f9b36a7e0baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-25844524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee3e861-5c9c-441b-a7cc-ae48c447c498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:20Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559123fd-c620-4464-80b2-b5ccd24f3d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559123fd-c620-4464-80b2-b5ccd24f3d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1c4fee-96be-4c63-9fda-26d16b372b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1c4fee-96be-4c63-9fda-26d16b372b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee3e861-5c9c-441b-a7cc-ae48c447c498', 'volume_name': 'volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790a674b-a547-45c8-99d8-fe9caff4f6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790a674b-a547-45c8-99d8-fe9caff4f6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07629c31-2715-4912-a61b-5867a1bab3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume 9ee3e861-5c9c-441b-a7cc-ae48c447c498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498', 'volume_size': 1} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-25844524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee3e861-5c9c-441b-a7cc-ae48c447c498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:20Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Creating volume 9ee3e861-5c9c-441b-a7cc-ae48c447c498 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:20 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:20 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 1073741824 Sep 25 11:54:20 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:20 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:20 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:20 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.475s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:20 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Deleted volume successfully. Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-75cf4fb2-8a37-4373-83d8-b32664d7aed0 tempest-CreateVolumesFromSourceVolumeTest-113302022 None] Lock "cinder-0c6ebfe8-715e-4fac-bf49-fe0fbd21a782-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Flow 'volume_create_manager' (a57a8e97-fb11-4629-b479-486c62adef98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bef9819-c6c8-4dff-8edb-7816fae4d9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bef9819-c6c8-4dff-8edb-7816fae4d9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188191382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47de6397-5964-4166-9d96-8655b8311afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22235741c7dd42448c37aa8017884fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:21Z,use_quota=True,user_id='b16c79e31d2148d581c178a1020ebe6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1680887-fe29-4246-8517-f110c23f9b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1680887-fe29-4246-8517-f110c23f9b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64a194c-56d7-4aa9-ac2b-4efe33fca133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64a194c-56d7-4aa9-ac2b-4efe33fca133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47de6397-5964-4166-9d96-8655b8311afe', 'volume_name': 'volume-47de6397-5964-4166-9d96-8655b8311afe', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52a2371-73c3-496a-9a2e-924fcea02f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52a2371-73c3-496a-9a2e-924fcea02f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de3bbd3-1ce7-4bea-964f-07e8ce2ab591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Volume 47de6397-5964-4166-9d96-8655b8311afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47de6397-5964-4166-9d96-8655b8311afe', 'volume_size': 1} Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:20 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 1073741824" returned: 0 in 0.839s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:21 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 Sep 25 11:54:21 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:21 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498" returned: 0 in 0.373s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188191382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47de6397-5964-4166-9d96-8655b8311afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22235741c7dd42448c37aa8017884fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:21Z,use_quota=True,user_id='b16c79e31d2148d581c178a1020ebe6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Creating volume 47de6397-5964-4166-9d96-8655b8311afe {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:21 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07629c31-2715-4912-a61b-5867a1bab3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebbff92-48ac-4d75-801a-ea7325cfa21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:21 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe 1073741824 Sep 25 11:54:21 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:21 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 (9ee3e861-5c9c-441b-a7cc-ae48c447c498): created successfully Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebbff92-48ac-4d75-801a-ea7325cfa21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (46bff03f-cc50-4607-ad10-30303f5812e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:21 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-55729bab-f37a-4977-a2ea-62e9883d2fe3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Created volume successfully. Sep 25 11:54:22 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe 1073741824" returned: 0 in 0.776s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:22 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe Sep 25 11:54:22 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:22 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe" returned: 0 in 0.416s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.106s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Creating offline snapshot 32602890-497a-4173-8e0c-7d0ffdf63e07 of volume 9ee3e861-5c9c-441b-a7cc-ae48c447c498 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de3bbd3-1ce7-4bea-964f-07e8ce2ab591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47de6397-5964-4166-9d96-8655b8311afe', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fa787b-917e-4907-b8b3-09f28a42e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91e637f-d5ed-42c0-8271-9133ecca8ce8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:22 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Volume volume-47de6397-5964-4166-9d96-8655b8311afe (47de6397-5964-4166-9d96-8655b8311afe): created successfully Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fa787b-917e-4907-b8b3-09f28a42e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Flow 'volume_create_manager' (a57a8e97-fb11-4629-b479-486c62adef98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0c5a8fe9-0ad7-4d4b-94a8-60350e777a43 tempest-ProjectReaderTests-1596241036 None] Created volume successfully. Sep 25 11:54:22 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 Sep 25 11:54:22 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:23 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498" returned: 0 in 0.618s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:23 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:23 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:23 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 1G Sep 25 11:54:23 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Flow 'volume_create_manager' (2bbd0fde-aebe-40cf-b33a-fb3812d3c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022d3591-6720-4564-b37d-507b9ef56c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022d3591-6720-4564-b37d-507b9ef56c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2018993041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6df346c-5797-4adc-bc8d-4d9ef82d245f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956dac4f522244dc938fe18cd09f4386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:24Z,use_quota=True,user_id='73081282675343fb8ed172c6d257c0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:23 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053928bd-8c14-4443-8498-c7bae262d969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053928bd-8c14-4443-8498-c7bae262d969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da4d782-1386-4fc6-9673-b781f9e00872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da4d782-1386-4fc6-9673-b781f9e00872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6df346c-5797-4adc-bc8d-4d9ef82d245f', 'volume_name': 'volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee21f93-4d87-42d2-b348-018d8a2f7e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee21f93-4d87-42d2-b348-018d8a2f7e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72dd739e-ca95-445a-a0a2-8026bdaa7514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:23 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Volume e6df346c-5797-4adc-bc8d-4d9ef82d245f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f', 'volume_size': 1} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.395s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:54:23 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 1G" returned: 0 in 0.579s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:24 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 Sep 25 11:54:24 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "cinder-47de6397-5964-4166-9d96-8655b8311afe-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Lock "cinder-47de6397-5964-4166-9d96-8655b8311afe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "cinder-quobyte-47de6397-5964-4166-9d96-8655b8311afe" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Lock "cinder-quobyte-47de6397-5964-4166-9d96-8655b8311afe" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b4fa09-9c62-4a67-9440-2eaec4dcfb39]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:24 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07" returned: 0 in 0.468s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:24 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 is being set with open permissions: ugo+rw Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:24 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 Sep 25 11:54:24 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:24 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe Sep 25 11:54:24 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:24 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:24 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.info Sep 25 11:54:24 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:24 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe" returned: 0 in 0.495s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:24 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe Sep 25 11:54:24 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:25 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.info" returned: 0 in 0.329s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:25 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.info is being set with open permissions: ugo+rw Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:25 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:25 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.info Sep 25 11:54:25 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-47de6397-5964-4166-9d96-8655b8311afe" returned: 0 in 0.296s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Lock "cinder-quobyte-47de6397-5964-4166-9d96-8655b8311afe" released by "delete_volume" :: held 0.863s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Created reservations ['10762d85-1425-4c4d-9cbc-ec768430f49c', 'e0185c63-e182-4eff-aab7-e99e2dec11ee', 'b307ef2e-b766-451b-8621-078217811f8d', '1150b50f-af54-42b0-90be-73569389225a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:25 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:25 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:25 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.info" returned: 0 in 0.374s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.879s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.816s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2018993041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6df346c-5797-4adc-bc8d-4d9ef82d245f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956dac4f522244dc938fe18cd09f4386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:24Z,use_quota=True,user_id='73081282675343fb8ed172c6d257c0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Creating volume e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:25 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:25 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f 1073741824 Sep 25 11:54:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f43929e1-43cc-4b99-a4af-c93e9ba991d5 tempest-CreateVolumesFromSnapshotTest-103990913 None] Create snapshot completed successfully Sep 25 11:54:25 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:25 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.520s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Deleted volume successfully. Sep 25 11:54:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7bab5f93-b1a4-4e2c-a909-a8ecb6f0a2c3 tempest-ProjectReaderTests-1596241036 None] Lock "cinder-47de6397-5964-4166-9d96-8655b8311afe-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:26 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Flow 'volume_create_manager' (16069dd0-59e5-482c-b597-fca444ab330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63865316-691a-487c-b703-a5e999d5a27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f 1073741824" returned: 0 in 0.954s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63865316-691a-487c-b703-a5e999d5a27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394958181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065b694-1153-446b-94d8-59504cf7a691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22235741c7dd42448c37aa8017884fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:26Z,use_quota=True,user_id='b16c79e31d2148d581c178a1020ebe6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302ff9ab-ebf7-4d81-b932-f1f7705ce3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302ff9ab-ebf7-4d81-b932-f1f7705ce3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e0a12b-c785-4bbd-bce7-aa71e80dead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e0a12b-c785-4bbd-bce7-aa71e80dead9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e065b694-1153-446b-94d8-59504cf7a691', 'volume_name': 'volume-e065b694-1153-446b-94d8-59504cf7a691', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2001e0b-6797-422e-8f84-870215e9b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2001e0b-6797-422e-8f84-870215e9b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6fd52f-71ba-462a-a3f4-b2c44d747de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Volume e065b694-1153-446b-94d8-59504cf7a691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e065b694-1153-446b-94d8-59504cf7a691', 'volume_size': 1} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:26 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f Sep 25 11:54:26 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (229ddd48-50a2-4d58-a095-054690276345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8336a8c2-b0c1-4c3c-82c6-324746a8660a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8336a8c2-b0c1-4c3c-82c6-324746a8660a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487334648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215cfc10-7572-44a6-a7f7-a00d2ea0fea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:27Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a031e416-3e56-476e-97ce-029266d15f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a031e416-3e56-476e-97ce-029266d15f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82227c49-fbae-4f46-bbe7-366a3b88cf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82227c49-fbae-4f46-bbe7-366a3b88cf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215cfc10-7572-44a6-a7f7-a00d2ea0fea9', 'volume_name': 'volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a60a5-0c15-4020-8677-bc04f7bc8321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a60a5-0c15-4020-8677-bc04f7bc8321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8542173-2d01-43ec-9dd9-91fb9379b3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:26 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume 215cfc10-7572-44a6-a7f7-a00d2ea0fea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9', 'volume_size': 1} Sep 25 11:54:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:27 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f" returned: 0 in 0.488s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394958181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065b694-1153-446b-94d8-59504cf7a691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22235741c7dd42448c37aa8017884fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:26Z,use_quota=True,user_id='b16c79e31d2148d581c178a1020ebe6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Creating volume e065b694-1153-446b-94d8-59504cf7a691 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:27 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72dd739e-ca95-445a-a0a2-8026bdaa7514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 1073741824 Sep 25 11:54:27 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41088a9-42ac-4059-b3d4-06cb04a407c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (123d3293-17a3-4b68-826c-345ecbb62f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4065fe-cd23-4a75-bbd6-79394347c392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Volume volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f (e6df346c-5797-4adc-bc8d-4d9ef82d245f): created successfully Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41088a9-42ac-4059-b3d4-06cb04a407c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Flow 'volume_create_manager' (2bbd0fde-aebe-40cf-b33a-fb3812d3c718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4065fe-cd23-4a75-bbd6-79394347c392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460820106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0822faf5-2815-400c-b43c-c2c30e7739bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:27Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402e8035-5e97-4c28-9205-b664cca1c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402e8035-5e97-4c28-9205-b664cca1c871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3878f8-c50a-42c9-87c4-b4fff6a9e186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3878f8-c50a-42c9-87c4-b4fff6a9e186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0822faf5-2815-400c-b43c-c2c30e7739bc', 'volume_name': 'volume-0822faf5-2815-400c-b43c-c2c30e7739bc', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54813715-490b-4afd-9993-dea2f241de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54813715-490b-4afd-9993-dea2f241de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaecfac-e69f-4fdb-97c3-334e91292fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume 0822faf5-2815-400c-b43c-c2c30e7739bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0822faf5-2815-400c-b43c-c2c30e7739bc', 'volume_size': 1} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:27 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fe5859bd-9032-48ce-a5d7-ca47548539b4 tempest-VolumeDependencyTests-1450609011 None] Created volume successfully. Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (d213477c-bd56-4f53-86e7-adc41c7a900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e454c35f-230e-4212-add1-a4d68c7662a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e454c35f-230e-4212-add1-a4d68c7662a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-652584255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9246613-2dc3-4997-9a79-98f0b90b178c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:28Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab79b79-ae13-4f94-a630-e12069bda61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab79b79-ae13-4f94-a630-e12069bda61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b5afd0-b0ee-4fa0-b988-ea8cfc7fa48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b5afd0-b0ee-4fa0-b988-ea8cfc7fa48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9246613-2dc3-4997-9a79-98f0b90b178c', 'volume_name': 'volume-c9246613-2dc3-4997-9a79-98f0b90b178c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6e48fe-3390-4f9b-b97c-1cf014028335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6e48fe-3390-4f9b-b97c-1cf014028335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b527df-5095-445c-a9bf-66a4f7bbefaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:27 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume c9246613-2dc3-4997-9a79-98f0b90b178c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9246613-2dc3-4997-9a79-98f0b90b178c', 'volume_size': 1} Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:27 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 1073741824" returned: 0 in 0.755s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:28 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 Sep 25 11:54:28 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:28 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691" returned: 0 in 0.460s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487334648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215cfc10-7572-44a6-a7f7-a00d2ea0fea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:27Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Creating volume 215cfc10-7572-44a6-a7f7-a00d2ea0fea9 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:28 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:28 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 1073741824 Sep 25 11:54:28 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6fd52f-71ba-462a-a3f4-b2c44d747de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e065b694-1153-446b-94d8-59504cf7a691', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa45321-6040-4424-923a-79e55fba17ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (3d061e23-d439-4df5-bc33-eb4df277dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43f8c99-7507-4e3c-9274-29d2cb6d4e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Volume volume-e065b694-1153-446b-94d8-59504cf7a691 (e065b694-1153-446b-94d8-59504cf7a691): created successfully Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa45321-6040-4424-923a-79e55fba17ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Flow 'volume_create_manager' (16069dd0-59e5-482c-b597-fca444ab330b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43f8c99-7507-4e3c-9274-29d2cb6d4e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-652670832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18233382-a57f-4c20-9f9b-684474e74d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:28Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fc7bec-3d72-40ff-a7bc-e4c1229b2749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fc7bec-3d72-40ff-a7bc-e4c1229b2749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36d348b-4b29-404d-889f-08f561395dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36d348b-4b29-404d-889f-08f561395dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18233382-a57f-4c20-9f9b-684474e74d8d', 'volume_name': 'volume-18233382-a57f-4c20-9f9b-684474e74d8d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03801e3a-c1a4-43fb-b273-94ab53f0b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03801e3a-c1a4-43fb-b273-94ab53f0b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07edd34a-4691-4608-b622-dd8c97cc2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume 18233382-a57f-4c20-9f9b-684474e74d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18233382-a57f-4c20-9f9b-684474e74d8d', 'volume_size': 1} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:28 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c02f2a51-017d-4cb4-854a-e9049c6ec839 tempest-ProjectReaderTests-1596241036 None] Created volume successfully. Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (50d94c0a-85a1-49e5-ac27-ff89daa11739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbdc7d0-7b2c-475b-a29e-188df37186b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbdc7d0-7b2c-475b-a29e-188df37186b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018241689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d2ef15-227f-49df-ae71-75f37e1647d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:29Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f0aa05-61cf-40c7-8906-9667bd456b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f0aa05-61cf-40c7-8906-9667bd456b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c597a09f-8ac0-4b2d-a26a-67666c4b67c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c597a09f-8ac0-4b2d-a26a-67666c4b67c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d2ef15-227f-49df-ae71-75f37e1647d2', 'volume_name': 'volume-40d2ef15-227f-49df-ae71-75f37e1647d2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780840ed-8101-413f-82bf-54b68fb58a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780840ed-8101-413f-82bf-54b68fb58a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a76424-ab5a-4488-9ebd-516906c68c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:29 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume 40d2ef15-227f-49df-ae71-75f37e1647d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d2ef15-227f-49df-ae71-75f37e1647d2', 'volume_size': 1} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:29 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 1073741824" returned: 0 in 0.639s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:29 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 Sep 25 11:54:29 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:29 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9" returned: 0 in 0.362s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.077s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460820106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0822faf5-2815-400c-b43c-c2c30e7739bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:27Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Creating volume 0822faf5-2815-400c-b43c-c2c30e7739bc {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:29 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8542173-2d01-43ec-9dd9-91fb9379b3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1705dba5-9fdc-4ec8-ab79-bb552f81ea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:29 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 (215cfc10-7572-44a6-a7f7-a00d2ea0fea9): created successfully Sep 25 11:54:29 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc 1073741824 Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1705dba5-9fdc-4ec8-ab79-bb552f81ea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:29 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (229ddd48-50a2-4d58-a095-054690276345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c8247444-69dc-414e-b9f9-0eb599a2bf4a tempest-CreateVolumesFromSnapshotTest-103990913 None] Created volume successfully. Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "cinder-e065b694-1153-446b-94d8-59504cf7a691-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Lock "cinder-e065b694-1153-446b-94d8-59504cf7a691-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Flow 'volume_create_manager' (894ae82a-eb90-4434-be9f-cab3f7f1787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53bd9608-9ba3-435a-863c-fef8756cba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "cinder-quobyte-e065b694-1153-446b-94d8-59504cf7a691" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53bd9608-9ba3-435a-863c-fef8756cba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999bf482-94d2-4364-916c-f6ddc7ea2f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f75281470fa4eb99c8c512eeabb977c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:30Z,use_quota=True,user_id='de648beee09c47dea4e0d3843e191603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334e98e0-6341-46b8-9e3e-2d906ed039d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334e98e0-6341-46b8-9e3e-2d906ed039d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8e7d85-83fe-4d4d-a94c-9015155869aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.image.glance [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Creating Keystone auth plugin from conf {{(pid=87356) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Lock "cinder-quobyte-e065b694-1153-446b-94d8-59504cf7a691" acquired by "delete_volume" :: waited 0.052s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351a2e5-cb1b-4ff4-85cf-f835d1178724]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:30 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 Sep 25 11:54:30 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8e7d85-83fe-4d4d-a94c-9015155869aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '999bf482-94d2-4364-916c-f6ddc7ea2f19', 'volume_name': 'volume-999bf482-94d2-4364-916c-f6ddc7ea2f19', 'volume_size': 1, 'image_id': 'c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8da600262ee7558e4419a03475498bf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f75281470fa4eb99c8c512eeabb977c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5d00e5f27d3ca887abeaf6e07f0e910f900a9a8bd70b055a7dcdd46c35b8212e5593cb5c3afebc99fb88738bc49eb45ec186405f160adbf91121b5e9ec32175', 'id': 'c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'created_at': datetime.datetime(2026, 9, 25, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 54, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35/file', 'properties': {}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91f5f87-5ab8-4558-bb60-5e3f91a3dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91f5f87-5ab8-4558-bb60-5e3f91a3dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13c7943-9219-42c3-8650-97fc92a6ba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:30 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Volume 999bf482-94d2-4364-916c-f6ddc7ea2f19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-999bf482-94d2-4364-916c-f6ddc7ea2f19', 'volume_size': 1, 'image_id': 'c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8da600262ee7558e4419a03475498bf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f75281470fa4eb99c8c512eeabb977c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5d00e5f27d3ca887abeaf6e07f0e910f900a9a8bd70b055a7dcdd46c35b8212e5593cb5c3afebc99fb88738bc49eb45ec186405f160adbf91121b5e9ec32175', 'id': 'c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'created_at': datetime.datetime(2026, 9, 25, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 54, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35/file', 'properties': {}}, 'image_service': } Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Trying to clone 999bf482-94d2-4364-916c-f6ddc7ea2f19 from image c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'metadata': {}}]). {{(pid=87356) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:54:30 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc 1073741824" returned: 0 in 0.806s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:30 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc Sep 25 11:54:30 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:54:30 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Image download 0.00 MB at 0.00 MB/s Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[80744e3d-99ee-47a3-9b92-418ab03a4973]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:30 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691" returned: 0 in 0.493s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:30 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691 Sep 25 11:54:30 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:30 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD Sep 25 11:54:30 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:30 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc" returned: 0 in 0.324s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-652584255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9246613-2dc3-4997-9a79-98f0b90b178c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:28Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Creating volume c9246613-2dc3-4997-9a79-98f0b90b178c {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:30 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaecfac-e69f-4fdb-97c3-334e91292fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0822faf5-2815-400c-b43c-c2c30e7739bc', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:30 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c 1073741824 Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38590337-5447-415f-852a-2a9674ef88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:30 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:30 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume volume-0822faf5-2815-400c-b43c-c2c30e7739bc (0822faf5-2815-400c-b43c-c2c30e7739bc): created successfully Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38590337-5447-415f-852a-2a9674ef88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (123d3293-17a3-4b68-826c-345ecbb62f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:30 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-dd111596-3e7a-4b7a-8529-368f5c0eab8b tempest-CreateVolumesFromSnapshotTest-103990913 None] Created volume successfully. Sep 25 11:54:30 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e065b694-1153-446b-94d8-59504cf7a691" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Lock "cinder-quobyte-e065b694-1153-446b-94d8-59504cf7a691" released by "delete_volume" :: held 0.909s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:31 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Created reservations ['0f6eb691-6ad7-46bc-8e82-a03d3ce5ae16', '97cb2d9b-91f7-49e4-a4c8-19f6b59f3df3', '59158285-20ef-40dd-97bc-18c424f52fa8', '713efd58-e897-447c-89f3-36a978cf2470'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD" returned: 0 in 0.551s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:31 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:31 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:31 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD Sep 25 11:54:31 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:31 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c 1073741824" returned: 0 in 0.667s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:31 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c Sep 25 11:54:31 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:31 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.316s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Deleted volume successfully. Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f662f78e-215e-455c-9dab-feb0407923b8 tempest-ProjectReaderTests-1596241036 None] Lock "cinder-e065b694-1153-446b-94d8-59504cf7a691-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:31 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD" returned: 1 in 0.518s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Temporary image c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35 is fetched for user de648beee09c47dea4e0d3843e191603. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d863e-692c-4393-bfef-7c946d69d83f]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:31 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c" returned: 0 in 0.314s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:31 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:31 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.047s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-652670832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18233382-a57f-4c20-9f9b-684474e74d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:28Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Creating volume 18233382-a57f-4c20-9f9b-684474e74d8d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:31 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b527df-5095-445c-a9bf-66a4f7bbefaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9246613-2dc3-4997-9a79-98f0b90b178c', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c76d22f-465e-4e3e-b8ef-ad46cdd54215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:31 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d 1073741824 Sep 25 11:54:31 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume volume-c9246613-2dc3-4997-9a79-98f0b90b178c (c9246613-2dc3-4997-9a79-98f0b90b178c): created successfully Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c76d22f-465e-4e3e-b8ef-ad46cdd54215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (d213477c-bd56-4f53-86e7-adc41c7a900d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-17624f07-072d-4831-8a56-250857e921f3 tempest-CreateVolumesFromSnapshotTest-103990913 None] Created volume successfully. Sep 25 11:54:32 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:32 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD Sep 25 11:54:32 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:32 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d 1073741824" returned: 0 in 0.609s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:32 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d Sep 25 11:54:32 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:32 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD" returned: 1 in 0.463s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:32 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d" returned: 0 in 0.316s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.993s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07edd34a-4691-4608-b622-dd8c97cc2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18233382-a57f-4c20-9f9b-684474e74d8d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf211ef-994b-4bf2-977e-43a141670361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Creating offline snapshot 45c6e3d3-7230-499e-9e15-83a654bc6a4d of volume e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:54:32 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume volume-18233382-a57f-4c20-9f9b-684474e74d8d (18233382-a57f-4c20-9f9b-684474e74d8d): created successfully Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf211ef-994b-4bf2-977e-43a141670361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (3d061e23-d439-4df5-bc33-eb4df277dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8bf00b-7958-4c97-9a54-f52e80251a5e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:32 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c3d5df80-6098-4a34-aa41-5d70052b57e2 tempest-CreateVolumesFromSnapshotTest-103990913 None] Created volume successfully. Sep 25 11:54:33 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f Sep 25 11:54:33 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:33 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f" returned: 0 in 0.493s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:33 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d 1G Sep 25 11:54:33 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:34 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d 1G" returned: 0 in 0.668s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:34 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d Sep 25 11:54:34 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:34 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d" returned: 0 in 0.370s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:34 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d is being set with open permissions: ugo+rw Sep 25 11:54:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:34 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d Sep 25 11:54:34 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:34 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d" returned: 0 in 0.334s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:34 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.info Sep 25 11:54:34 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:35 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.info" returned: 0 in 0.363s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:35 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.info is being set with open permissions: ugo+rw Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:35 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.info Sep 25 11:54:35 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:35 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.info" returned: 0 in 0.308s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.553s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018241689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d2ef15-227f-49df-ae71-75f37e1647d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b407c1591c4416898ccf7b5bdffd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:29Z,use_quota=True,user_id='c2a3b61e632b48d7aa07d26f8b50b4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Creating volume 40d2ef15-227f-49df-ae71-75f37e1647d2 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:35 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:35 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 1073741824 Sep 25 11:54:35 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:35 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-122078db-f90d-43a0-a4ea-386284d96804 tempest-VolumeDependencyTests-1450609011 None] Create snapshot completed successfully Sep 25 11:54:36 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 1073741824" returned: 0 in 0.597s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:36 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 Sep 25 11:54:36 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:36 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2" returned: 0 in 0.313s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.932s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999bf482-94d2-4364-916c-f6ddc7ea2f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f75281470fa4eb99c8c512eeabb977c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:30Z,use_quota=True,user_id='de648beee09c47dea4e0d3843e191603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Creating volume 999bf482-94d2-4364-916c-f6ddc7ea2f19 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:36 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:36 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 1073741824 Sep 25 11:54:36 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a76424-ab5a-4488-9ebd-516906c68c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d2ef15-227f-49df-ae71-75f37e1647d2', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92af2de1-3e37-4c91-9059-ab3bfb19929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:36 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Volume volume-40d2ef15-227f-49df-ae71-75f37e1647d2 (40d2ef15-227f-49df-ae71-75f37e1647d2): created successfully Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92af2de1-3e37-4c91-9059-ab3bfb19929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Flow 'volume_create_manager' (50d94c0a-85a1-49e5-ac27-ff89daa11739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-477e5ce2-934a-48f2-849a-052e631100d6 tempest-CreateVolumesFromSnapshotTest-103990913 None] Created volume successfully. Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Flow 'volume_create_manager' (b1f83f92-5dca-448e-9e6f-5e2dd9b7a2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e7ead8-bf81-41c1-ba82-9d010c4857fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e7ead8-bf81-41c1-ba82-9d010c4857fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-953575312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e343596-82aa-4c0f-bcf6-4848dccc8671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956dac4f522244dc938fe18cd09f4386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45c6e3d3-7230-499e-9e15-83a654bc6a4d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:37Z,use_quota=True,user_id='73081282675343fb8ed172c6d257c0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7897be44-005a-4d40-a55a-3ae823d8c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7897be44-005a-4d40-a55a-3ae823d8c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b8b8d4-a8f5-40c0-b2c3-76482c4b48b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b8b8d4-a8f5-40c0-b2c3-76482c4b48b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e343596-82aa-4c0f-bcf6-4848dccc8671', 'volume_name': 'volume-6e343596-82aa-4c0f-bcf6-4848dccc8671', 'volume_size': 1, 'snapshot_id': '45c6e3d3-7230-499e-9e15-83a654bc6a4d'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d993de6-50aa-4810-b814-2621fd0e1f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d993de6-50aa-4810-b814-2621fd0e1f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ec30d3-00de-4084-93ea-cf5d75362b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:36 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Volume 6e343596-82aa-4c0f-bcf6-4848dccc8671: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e343596-82aa-4c0f-bcf6-4848dccc8671', 'volume_size': 1, 'snapshot_id': '45c6e3d3-7230-499e-9e15-83a654bc6a4d'} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-40d2ef15-227f-49df-ae71-75f37e1647d2-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-40d2ef15-227f-49df-ae71-75f37e1647d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-quobyte-40d2ef15-227f-49df-ae71-75f37e1647d2" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-40d2ef15-227f-49df-ae71-75f37e1647d2" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2044be-98c2-4875-b108-7933a9f3a7d2]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:37 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 Sep 25 11:54:37 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:37 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 1073741824" returned: 0 in 0.847s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:37 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 Sep 25 11:54:37 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:37 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2" returned: 0 in 0.576s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:37 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2 Sep 25 11:54:37 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:37 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19" returned: 0 in 0.383s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.863s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-quobyte-45c6e3d3-7230-499e-9e15-83a654bc6a4d-6e343596-82aa-4c0f-bcf6-4848dccc8671" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-45c6e3d3-7230-499e-9e15-83a654bc6a4d-6e343596-82aa-4c0f-bcf6-4848dccc8671" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Creating volume 6e343596-82aa-4c0f-bcf6-4848dccc8671 from snapshot 45c6e3d3-7230-499e-9e15-83a654bc6a4d {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-quobyte-6e343596-82aa-4c0f-bcf6-4848dccc8671" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Attempting download of c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'metadata': {}}])) to volume 999bf482-94d2-4364-916c-f6ddc7ea2f19. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-6e343596-82aa-4c0f-bcf6-4848dccc8671" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] snapshot: 45c6e3d3-7230-499e-9e15-83a654bc6a4d, volume: 6e343596-82aa-4c0f-bcf6-4848dccc8671, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1a738-aef5-4d3c-a757-8d031479e41c]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_e1fxiyjn {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce7cc9-db70-4cd2-9c57-2820379ca7e0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:38 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-40d2ef15-227f-49df-ae71-75f37e1647d2" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-40d2ef15-227f-49df-ae71-75f37e1647d2" released by "delete_volume" :: held 0.998s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:38 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d Sep 25 11:54:38 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:38 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_e1fxiyjn Sep 25 11:54:38 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Created reservations ['946b3d19-71a9-4982-b5bf-b00b94413221', 'd574937f-5e16-409b-92cc-40bf6a02cc00', 'b68a9473-b016-4309-a380-39d3922fb3c8', 'f31bd7bd-e3f2-4546-92fe-c5ee0d714d43'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:38 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:38 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:38 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_e1fxiyjn" returned: 0 in 0.579s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_e1fxiyjn {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:38 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d" returned: 0 in 0.614s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ad601-93a7-48ca-a151-41c07a1a8bec]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:38 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_e1fxiyjn Sep 25 11:54:38 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:38 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f Sep 25 11:54:38 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:38 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.466s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:38 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Deleted volume successfully. Sep 25 11:54:38 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-867597fe-5569-4526-b1cd-d584c993383c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-40d2ef15-227f-49df-ae71-75f37e1647d2-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:39 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_e1fxiyjn" returned: 1 in 0.544s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_e1fxiyjn' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[513bfa75-4883-4c20-ac45-4633d693b3e0]: (4, 'raw') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:39 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f" returned: 0 in 0.611s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:54:39 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD Sep 25 11:54:39 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:39 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 Sep 25 11:54:39 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-18233382-a57f-4c20-9f9b-684474e74d8d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-18233382-a57f-4c20-9f9b-684474e74d8d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-quobyte-18233382-a57f-4c20-9f9b-684474e74d8d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-18233382-a57f-4c20-9f9b-684474e74d8d" acquired by "delete_volume" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:39 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7882c7-a16d-4ac7-8f06-f492b14a7040]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:39 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d Sep 25 11:54:39 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:39 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD Sep 25 11:54:39 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:40 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD" returned: 1 in 0.594s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD' failed. Not Retrying. {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:40 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35 was raw, converting to qcow2 {{(pid=87356) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:54:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:40 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 Sep 25 11:54:40 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:40 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d" returned: 0 in 0.749s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:40 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d Sep 25 11:54:40 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:41 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-18233382-a57f-4c20-9f9b-684474e74d8d" returned: 0 in 0.771s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-18233382-a57f-4c20-9f9b-684474e74d8d" released by "delete_volume" :: held 1.640s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Created reservations ['564a15a1-c411-40a7-aeb1-97b6a20d2f2e', '82acd584-2612-4035-8291-a7a5226016c3', '81a2afb6-8fcf-4c64-885d-724a4a058d67', 'f1b6d41f-b4ae-48dc-ae31-63fe9496ca98'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:41 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:41 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:41 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19" returned: 0 in 1.631s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35_etltxd09devstack@QuobyteHD, size 0.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:54:41 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 11:54:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:41 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 1G Sep 25 11:54:42 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-c9246613-2dc3-4997-9a79-98f0b90b178c-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-c9246613-2dc3-4997-9a79-98f0b90b178c-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-quobyte-c9246613-2dc3-4997-9a79-98f0b90b178c" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:42 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.855s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-c9246613-2dc3-4997-9a79-98f0b90b178c" acquired by "delete_volume" :: waited 0.042s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:42 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Deleted volume successfully. Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58156a-3574-4af8-9e88-26aebdfb1647]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-4de5cafd-e828-4c49-97c5-931558b2d10c tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-18233382-a57f-4c20-9f9b-684474e74d8d-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:42 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c Sep 25 11:54:42 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:42 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 1G" returned: 0 in 1.036s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Downloaded image c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'metadata': {}}])) to volume 999bf482-94d2-4364-916c-f6ddc7ea2f19 successfully. {{(pid=87356) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Temporary image c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35 for user de648beee09c47dea4e0d3843e191603 is deleted. {{(pid=87356) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:54:42 devstack cinder-volume[87356]: DEBUG cinder.volume.volume_utils [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Marking volume 999bf482-94d2-4364-916c-f6ddc7ea2f19 as bootable. {{(pid=87356) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:54:43 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Copying metadata from image c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35 to 999bf482-94d2-4364-916c-f6ddc7ea2f19. {{(pid=87356) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:54:43 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Creating volume glance metadata for volume 999bf482-94d2-4364-916c-f6ddc7ea2f19 backed by image c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35 with: {'image_id': 'c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8da600262ee7558e4419a03475498bf1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87356) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:54:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13c7943-9219-42c3-8650-97fc92a6ba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999bf482-94d2-4364-916c-f6ddc7ea2f19', 'volume_size': 1, 'image_id': 'c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8da600262ee7558e4419a03475498bf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f75281470fa4eb99c8c512eeabb977c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5d00e5f27d3ca887abeaf6e07f0e910f900a9a8bd70b055a7dcdd46c35b8212e5593cb5c3afebc99fb88738bc49eb45ec186405f160adbf91121b5e9ec32175', 'id': 'c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35', 'created_at': datetime.datetime(2026, 9, 25, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 54, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5dd73d7-f2f6-469b-b9a4-1a98f1a28e35/file', 'properties': {}}, 'image_service': }' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bef467-8b6a-439c-811a-9d47a512f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:43 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Volume volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 (999bf482-94d2-4364-916c-f6ddc7ea2f19): created successfully Sep 25 11:54:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bef467-8b6a-439c-811a-9d47a512f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:43 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Flow 'volume_create_manager' (894ae82a-eb90-4434-be9f-cab3f7f1787a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:43 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-cc62a4a6-f1c2-489d-9339-213195686700 tempest-VolumeImageDependencyTests-702120808 None] Created volume successfully. Sep 25 11:54:43 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c" returned: 0 in 0.906s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:43 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c Sep 25 11:54:43 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:44 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-c9246613-2dc3-4997-9a79-98f0b90b178c" returned: 0 in 0.577s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-c9246613-2dc3-4997-9a79-98f0b90b178c" released by "delete_volume" :: held 1.589s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=194,cinder:SELECT=149,cinder:DELETE=18,cinder:INSERT=51 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Created reservations ['09e4c5c4-5183-47ac-9f17-c4e842f8af00', 'b9d9677b-5060-4485-9aa4-964b60f672d9', 'c9d81bd7-39d7-4224-97d0-ac4a20cfb81c', 'ac591454-2cba-4f43-a5e6-9d0bb3ee8c6a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=147,cinder:UPDATE=209,cinder:INSERT=59,cinder:DELETE=22 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:44 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:44 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:44 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.423s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-0822faf5-2815-400c-b43c-c2c30e7739bc-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Deleted volume successfully. Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-0822faf5-2815-400c-b43c-c2c30e7739bc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-73c3220c-b0c8-4346-b63c-030529f92605 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-c9246613-2dc3-4997-9a79-98f0b90b178c-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-quobyte-0822faf5-2815-400c-b43c-c2c30e7739bc" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Acquiring lock "cinder-999bf482-94d2-4364-916c-f6ddc7ea2f19-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-0822faf5-2815-400c-b43c-c2c30e7739bc" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Lock "cinder-999bf482-94d2-4364-916c-f6ddc7ea2f19-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13cab2c-027e-4de1-a848-89434c43afc3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Acquiring lock "cinder-quobyte-999bf482-94d2-4364-916c-f6ddc7ea2f19" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Lock "cinder-quobyte-999bf482-94d2-4364-916c-f6ddc7ea2f19" acquired by "delete_volume" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb749d-28e8-48fd-9cc0-bb6b440c0912]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:45 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc Sep 25 11:54:45 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:45 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 Sep 25 11:54:45 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:45 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc" returned: 0 in 0.809s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:46 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc Sep 25 11:54:46 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:46 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-0822faf5-2815-400c-b43c-c2c30e7739bc" returned: 0 in 0.845s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:46 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19" returned: 0 in 1.525s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-0822faf5-2815-400c-b43c-c2c30e7739bc" released by "delete_volume" :: held 1.810s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:46 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19 Sep 25 11:54:46 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:46 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Created reservations ['9887ea2c-4262-48fc-9e96-50df6d95d096', 'c69e3c2a-bd4e-412c-ab10-d1beed1d0cec', '55c0ee65-11dc-47bf-9cd4-b1ff14eddea7', '684057f3-e082-430e-a5fa-7375cd42d2c0'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:47 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-999bf482-94d2-4364-916c-f6ddc7ea2f19" returned: 0 in 0.521s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:47 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:47 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Lock "cinder-quobyte-999bf482-94d2-4364-916c-f6ddc7ea2f19" released by "delete_volume" :: held 2.175s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-215cfc10-7572-44a6-a7f7-a00d2ea0fea9-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-215cfc10-7572-44a6-a7f7-a00d2ea0fea9-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Created reservations ['7619e399-9649-4e22-9445-bca33f4a2dd9', '115c5347-2e05-4324-a381-0daf1204a384', 'e03d3169-243f-46fe-9f9d-8abac8398d3c', 'c08ee53f-e372-46f5-9aa3-231f5b01a1ee'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-quobyte-215cfc10-7572-44a6-a7f7-a00d2ea0fea9" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-215cfc10-7572-44a6-a7f7-a00d2ea0fea9" acquired by "delete_volume" :: waited 0.043s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c750674-123a-4fd2-907a-4158de512486]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:47 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.596s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Deleted volume successfully. Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f3cd9f3e-7150-4fb0-9e60-2ec31b73f1fd tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-0822faf5-2815-400c-b43c-c2c30e7739bc-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:48 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:48 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:48 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 Sep 25 11:54:48 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:48 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.568s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:48 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:48 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Deleted volume successfully. Sep 25 11:54:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b292139d-74a8-415c-b1eb-e8ed06f2d997 tempest-VolumeImageDependencyTests-702120808 None] Lock "cinder-999bf482-94d2-4364-916c-f6ddc7ea2f19-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:48 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9" returned: 0 in 1.143s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:49 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9 Sep 25 11:54:49 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:49 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-215cfc10-7572-44a6-a7f7-a00d2ea0fea9" returned: 0 in 0.600s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-215cfc10-7572-44a6-a7f7-a00d2ea0fea9" released by "delete_volume" :: held 1.902s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Created reservations ['2951653b-4461-419d-a9f8-5642bae38396', 'a6bd74d4-056c-429c-8353-4bd9b427701b', '39033f73-97a3-4cde-b22f-fb22d7d66fa7', '1fec3c11-b96a-4076-9b2d-a24ee6de4756'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:49 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671" returned: 0 in 10.486s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f, size 1024.00 MB, duration 10.49 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:54:49 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Converted 1024.00 MB image at 97.64 MB/s Sep 25 11:54:49 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 is being set with open permissions: ugo+rw Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:49 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 Sep 25 11:54:49 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:49 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:49 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-32602890-497a-4173-8e0c-7d0ffdf63e07-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-32602890-497a-4173-8e0c-7d0ffdf63e07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-quobyte-9ee3e861-5c9c-441b-a7cc-ae48c447c498" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-9ee3e861-5c9c-441b-a7cc-ae48c447c498" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-quobyte-32602890-497a-4173-8e0c-7d0ffdf63e07" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-32602890-497a-4173-8e0c-7d0ffdf63e07" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Deleting offline snapshot 32602890-497a-4173-8e0c-7d0ffdf63e07 of volume 9ee3e861-5c9c-441b-a7cc-ae48c447c498 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] snapshot_file for this snap is: volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c8d3d9-f123-48e0-9d00-985c1f360dd6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:50 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 Sep 25 11:54:50 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:50 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671" returned: 0 in 0.496s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-6e343596-82aa-4c0f-bcf6-4848dccc8671" released by "_copy_volume_from_snapshot" :: held 12.373s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:50 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.446s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Deleted volume successfully. Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-45c6e3d3-7230-499e-9e15-83a654bc6a4d-6e343596-82aa-4c0f-bcf6-4848dccc8671" released by "_create_volume_from_snapshot" :: held 12.500s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.544s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-390573b7-ccbb-404e-9283-2e5dd91b5b58 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-215cfc10-7572-44a6-a7f7-a00d2ea0fea9-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ec30d3-00de-4084-93ea-cf5d75362b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e343596-82aa-4c0f-bcf6-4848dccc8671', 'volume_size': 1, 'snapshot_id': '45c6e3d3-7230-499e-9e15-83a654bc6a4d'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb5f900-bd87-4cfe-b5fc-8212c2ec750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:50 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Volume volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 (6e343596-82aa-4c0f-bcf6-4848dccc8671): created successfully Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb5f900-bd87-4cfe-b5fc-8212c2ec750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Flow 'volume_create_manager' (b1f83f92-5dca-448e-9e6f-5e2dd9b7a2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:50 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a3ce1d54-0724-4a9f-a873-0a3cd6364219 tempest-VolumeDependencyTests-1450609011 None] Created volume successfully. Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-45c6e3d3-7230-499e-9e15-83a654bc6a4d-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-45c6e3d3-7230-499e-9e15-83a654bc6a4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-quobyte-e6df346c-5797-4adc-bc8d-4d9ef82d245f" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-e6df346c-5797-4adc-bc8d-4d9ef82d245f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-quobyte-45c6e3d3-7230-499e-9e15-83a654bc6a4d" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:50 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07" returned: 0 in 0.605s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-45c6e3d3-7230-499e-9e15-83a654bc6a4d" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Deleting offline snapshot 45c6e3d3-7230-499e-9e15-83a654bc6a4d of volume e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] snapshot_file for this snap is: volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f62af0-94bd-4039-beac-9f530eca08ed]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc0c645-9bdf-4848-afba-31411cd539c3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:51 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 Sep 25 11:54:51 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:51 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d Sep 25 11:54:51 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:51 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:51 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d" returned: 0 in 0.549s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498" returned: 0 in 0.610s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:51 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[188becfb-b08d-4285-b6f0-e6afdcd7c2b8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:51 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 Sep 25 11:54:51 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:51 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f Sep 25 11:54:51 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:52 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07" returned: 0 in 0.636s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:52 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07 Sep 25 11:54:52 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:52 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f" returned: 0 in 0.772s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:52 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d Sep 25 11:54:52 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:52 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498.32602890-497a-4173-8e0c-7d0ffdf63e07" returned: 0 in 0.392s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-32602890-497a-4173-8e0c-7d0ffdf63e07" released by "_delete_snapshot" :: held 2.460s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-9ee3e861-5c9c-441b-a7cc-ae48c447c498" released by "delete_snapshot" :: held 2.490s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Created reservations ['3f9de66b-6bab-49ad-a136-f7567b513906', 'e7e13cd1-befa-4faf-b0b3-bf142685bf4d', '2e80d5fe-893c-4434-b739-1c83ea1089b0', '0940d511-f304-4f65-bf53-10bd71b48267'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:52 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Delete snapshot completed successfully. Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0e1a87ed-287f-4b39-b834-b8df3c556f93 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-32602890-497a-4173-8e0c-7d0ffdf63e07-delete_snapshot" released by "delete_snapshot" :: held 2.756s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:52 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d" returned: 0 in 0.564s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:52 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d Sep 25 11:54:52 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:53 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f.45c6e3d3-7230-499e-9e15-83a654bc6a4d" returned: 0 in 0.448s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-45c6e3d3-7230-499e-9e15-83a654bc6a4d" released by "_delete_snapshot" :: held 2.568s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-e6df346c-5797-4adc-bc8d-4d9ef82d245f" released by "delete_snapshot" :: held 2.645s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-9ee3e861-5c9c-441b-a7cc-ae48c447c498-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-9ee3e861-5c9c-441b-a7cc-ae48c447c498-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Created reservations ['b1722b58-846c-4afb-b070-a0bae23fdfe4', 'df1c6ea3-590c-4ce2-ab79-affebacc5bb0', '81ee0045-3871-42be-8b53-219a2e45a9ae', '0e7d7ac4-a890-44f4-b4b1-2719d0ddb3e9'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "cinder-quobyte-9ee3e861-5c9c-441b-a7cc-ae48c447c498" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-9ee3e861-5c9c-441b-a7cc-ae48c447c498" acquired by "delete_volume" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b868b5dc-46db-4b6c-87d8-d419b7a47f51]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:53 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Delete snapshot completed successfully. Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-1b4ac244-9e4f-46d7-afeb-bdf8bf44ae16 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-45c6e3d3-7230-499e-9e15-83a654bc6a4d-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:53 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 Sep 25 11:54:53 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:53 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-e6df346c-5797-4adc-bc8d-4d9ef82d245f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-e6df346c-5797-4adc-bc8d-4d9ef82d245f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-quobyte-e6df346c-5797-4adc-bc8d-4d9ef82d245f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-e6df346c-5797-4adc-bc8d-4d9ef82d245f" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43efd84-3aef-49a1-9bf7-b6e300080a25]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:54 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498" returned: 0 in 0.642s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:54 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498 Sep 25 11:54:54 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:54 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f Sep 25 11:54:54 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:54 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9ee3e861-5c9c-441b-a7cc-ae48c447c498" returned: 0 in 0.354s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-quobyte-9ee3e861-5c9c-441b-a7cc-ae48c447c498" released by "delete_volume" :: held 1.120s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-01cf653d-e51c-4476-a491-347ac1228014 tempest-ProjectAdminTests-1842692846 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.434913635254, 'free_capacity_gb': 1775.434913635254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87356) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Created reservations ['3e3ff293-81b5-4342-8a82-164fe4c38b0a', '9ca61917-b70d-4091-950c-37817d94398c', 'fc23f13b-64d2-4daf-b54f-67d329ff9131', '91d532b9-51b5-4875-abd8-7a306a604999'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:54 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f" returned: 0 in 0.673s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:54 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f Sep 25 11:54:54 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:55 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:55 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:55 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e6df346c-5797-4adc-bc8d-4d9ef82d245f" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-e6df346c-5797-4adc-bc8d-4d9ef82d245f" released by "delete_volume" :: held 1.246s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:55 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Deleted volume successfully. Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Created reservations ['0c74b6cb-a829-4257-9102-1f578c87e590', '6a4e1cfa-3d4a-4196-82bc-e2d3f164cf12', '5bccd75b-1158-47f7-85ee-c98b7a5757b1', 'af6b4181-6ce1-493b-9226-4faba260b601'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-85021a87-de7e-4716-8c44-756a29d9a497 tempest-CreateVolumesFromSnapshotTest-103990913 None] Lock "cinder-9ee3e861-5c9c-441b-a7cc-ae48c447c498-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:55 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:55 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:55 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.382s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:55 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Deleted volume successfully. Sep 25 11:54:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-f142d5fa-72f6-45bf-b509-d9b429c15293 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-e6df346c-5797-4adc-bc8d-4d9ef82d245f-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-6e343596-82aa-4c0f-bcf6-4848dccc8671-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-6e343596-82aa-4c0f-bcf6-4848dccc8671-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "cinder-quobyte-6e343596-82aa-4c0f-bcf6-4848dccc8671" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-6e343596-82aa-4c0f-bcf6-4848dccc8671" acquired by "delete_volume" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0dc2bb-f2f7-4e64-8788-5fd38beddd77]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:56 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 Sep 25 11:54:56 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:57 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671" returned: 0 in 0.552s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:57 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671 Sep 25 11:54:57 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:57 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-6e343596-82aa-4c0f-bcf6-4848dccc8671" returned: 0 in 0.355s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-quobyte-6e343596-82aa-4c0f-bcf6-4848dccc8671" released by "delete_volume" :: held 0.996s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Created reservations ['ecbe46a4-e270-43d9-bb89-600e54d5568b', 'ca6575ef-35d9-4c8a-8a2e-be7957c52665', '727a2389-be81-40c5-a7e7-b3b15ba4e7e7', '169d8585-e044-4ea3-8429-4aff007fd4ff'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:57 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:54:57 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:58 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.408s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:58 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Deleted volume successfully. Sep 25 11:54:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c75bc151-2423-4e2b-9dc0-5b4be1b24765 tempest-VolumeDependencyTests-1450609011 None] Lock "cinder-6e343596-82aa-4c0f-bcf6-4848dccc8671-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (ef889545-15a5-437f-95a9-9472bdfa57f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41e1e71-e0fc-462f-8134-36bfb3cf88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41e1e71-e0fc-462f-8134-36bfb3cf88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077267816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da23e6d7-e58d-4d68-9a14-52d232ffe3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:05Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b77e6f5-7fab-4e10-b1f2-e85133de5739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b77e6f5-7fab-4e10-b1f2-e85133de5739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e42d460-355f-4449-88a0-65551b25a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e42d460-355f-4449-88a0-65551b25a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da23e6d7-e58d-4d68-9a14-52d232ffe3ff', 'volume_name': 'volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2afe2ed-10d0-4df4-9481-1c793fa4deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2afe2ed-10d0-4df4-9481-1c793fa4deea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65a5a37-e331-4a66-9b76-bc8c18ee73e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:04 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Volume da23e6d7-e58d-4d68-9a14-52d232ffe3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff', 'volume_size': 1} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077267816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da23e6d7-e58d-4d68-9a14-52d232ffe3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:05Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Creating volume da23e6d7-e58d-4d68-9a14-52d232ffe3ff {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:04 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:04 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff 1073741824 Sep 25 11:55:04 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:05 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff 1073741824" returned: 0 in 0.886s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:05 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff Sep 25 11:55:05 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:06 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" returned: 0 in 0.473s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65a5a37-e331-4a66-9b76-bc8c18ee73e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9684fc1-c19c-42dc-8cab-363c76a9f62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:06 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Volume volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff (da23e6d7-e58d-4d68-9a14-52d232ffe3ff): created successfully Sep 25 11:55:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9684fc1-c19c-42dc-8cab-363c76a9f62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:06 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (ef889545-15a5-437f-95a9-9472bdfa57f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:06 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-7ec12ac0-f949-42a3-a2d5-a1c363de780b tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Flow 'volume_create_manager' (2af4ddbf-4701-4ef7-a228-3b60719bae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f269e08c-75e9-4c6c-a8a2-968b084ea233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f269e08c-75e9-4c6c-a8a2-968b084ea233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9021e9-1c08-4e67-9fd4-abc694cbc36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c32c1b0fe741a6a6661c88cceb128d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:08Z,use_quota=True,user_id='0b47baed0317477889ee847c161f67df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e85380c-17bf-49a1-8605-d7ab74d97a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e85380c-17bf-49a1-8605-d7ab74d97a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36c48e3-1ba7-4ed9-8b1c-7192d028b1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36c48e3-1ba7-4ed9-8b1c-7192d028b1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9021e9-1c08-4e67-9fd4-abc694cbc36f', 'volume_name': 'volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5842dfe-c43c-4446-96cd-4020302d7aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5842dfe-c43c-4446-96cd-4020302d7aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630b0a2e-18c8-4c31-a219-65d779497efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Volume fd9021e9-1c08-4e67-9fd4-abc694cbc36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f', 'volume_size': 1} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9021e9-1c08-4e67-9fd4-abc694cbc36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c32c1b0fe741a6a6661c88cceb128d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:08Z,use_quota=True,user_id='0b47baed0317477889ee847c161f67df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Creating volume fd9021e9-1c08-4e67-9fd4-abc694cbc36f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:07 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:07 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f 1073741824 Sep 25 11:55:07 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:08 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f 1073741824" returned: 0 in 0.697s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:08 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f Sep 25 11:55:08 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:08 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f" returned: 0 in 0.355s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.069s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630b0a2e-18c8-4c31-a219-65d779497efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:08 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501e4151-635e-4f8d-91c1-f6fa93ea9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Creating offline snapshot 71f51154-2b25-4ae7-9157-1434cc3c7af5 of volume da23e6d7-e58d-4d68-9a14-52d232ffe3ff {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:55:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Volume volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f (fd9021e9-1c08-4e67-9fd4-abc694cbc36f): created successfully Sep 25 11:55:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501e4151-635e-4f8d-91c1-f6fa93ea9350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Flow 'volume_create_manager' (2af4ddbf-4701-4ef7-a228-3b60719bae6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:09 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d49a878-3ed7-4fb1-8c77-ba9ad70e3467]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:09 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c271d75c-1d74-4476-9cdb-9a1ba46306a5 tempest-CinderUnicodeTest-628620605 None] Created volume successfully. Sep 25 11:55:09 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff Sep 25 11:55:09 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:09 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" returned: 0 in 0.544s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:09 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 1G Sep 25 11:55:09 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:10 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 1G" returned: 0 in 0.782s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:10 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 Sep 25 11:55:10 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:10 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5" returned: 0 in 0.503s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:10 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 is being set with open permissions: ugo+rw Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:10 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 Sep 25 11:55:10 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Flow 'volume_create_manager' (5ced8c9e-2b94-46d2-a7a1-3ebf952dd8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ada2d19-48a8-48ef-9d21-a02b9ba0012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ada2d19-48a8-48ef-9d21-a02b9ba0012f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-374424047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b8adfe-584e-43e4-8763-6ff464bae759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c32c1b0fe741a6a6661c88cceb128d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:11Z,use_quota=True,user_id='0b47baed0317477889ee847c161f67df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf7f3fc-371f-45e8-b54f-961eeb5ae009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf7f3fc-371f-45e8-b54f-961eeb5ae009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb41c56-0162-4f7a-bd9b-bb5fa8507b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb41c56-0162-4f7a-bd9b-bb5fa8507b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b8adfe-584e-43e4-8763-6ff464bae759', 'volume_name': 'volume-55b8adfe-584e-43e4-8763-6ff464bae759', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1e03d7-05bb-4b2c-91b9-31b4ec9468ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1e03d7-05bb-4b2c-91b9-31b4ec9468ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe0f0b1-9ba1-4ff4-91c4-e10a71360b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:11 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Volume 55b8adfe-584e-43e4-8763-6ff464bae759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b8adfe-584e-43e4-8763-6ff464bae759', 'volume_size': 1} Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:11 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5" returned: 0 in 0.383s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:11 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.info Sep 25 11:55:11 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:11 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.info" returned: 0 in 0.374s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:11 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.info is being set with open permissions: ugo+rw Sep 25 11:55:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:11 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.info Sep 25 11:55:11 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:12 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.info" returned: 0 in 0.351s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.107s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-374424047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b8adfe-584e-43e4-8763-6ff464bae759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c32c1b0fe741a6a6661c88cceb128d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:11Z,use_quota=True,user_id='0b47baed0317477889ee847c161f67df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Creating volume 55b8adfe-584e-43e4-8763-6ff464bae759 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:12 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:12 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-38cf6324-0ed6-44f6-abdf-18be0a67b9b7 tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:55:12 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 1073741824 Sep 25 11:55:12 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:12 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 1073741824" returned: 0 in 0.805s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:13 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 Sep 25 11:55:13 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-71f51154-2b25-4ae7-9157-1434cc3c7af5-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Lock "cinder-71f51154-2b25-4ae7-9157-1434cc3c7af5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-71f51154-2b25-4ae7-9157-1434cc3c7af5" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-71f51154-2b25-4ae7-9157-1434cc3c7af5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot 71f51154-2b25-4ae7-9157-1434cc3c7af5 of volume da23e6d7-e58d-4d68-9a14-52d232ffe3ff {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a81f2-8e15-4684-9e38-c0c77cadecac]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:13 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759" returned: 0 in 0.467s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe0f0b1-9ba1-4ff4-91c4-e10a71360b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b8adfe-584e-43e4-8763-6ff464bae759', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e9be3c-906b-46c5-8aa4-cdca37546bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:13 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Volume volume-55b8adfe-584e-43e4-8763-6ff464bae759 (55b8adfe-584e-43e4-8763-6ff464bae759): created successfully Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e9be3c-906b-46c5-8aa4-cdca37546bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Flow 'volume_create_manager' (5ced8c9e-2b94-46d2-a7a1-3ebf952dd8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-907fa191-7286-4e44-83bc-5c173fb8dd62 tempest-CinderUnicodeTest-628620605 None] Created volume successfully. Sep 25 11:55:13 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 Sep 25 11:55:13 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:13 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5" returned: 0 in 0.471s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb95439-406e-4c43-bea7-653a06de1527]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:14 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff Sep 25 11:55:14 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Creating offline snapshot 875aeb46-c7b2-4df3-b5bb-012e52a3ab0f of volume 55b8adfe-584e-43e4-8763-6ff464bae759 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:55:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf10401-7920-496d-b907-1c85c0c6572d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:14 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" returned: 0 in 0.711s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:14 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 Sep 25 11:55:14 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:14 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 Sep 25 11:55:14 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:15 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759" returned: 0 in 0.560s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:15 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f 1G Sep 25 11:55:15 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:15 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5" returned: 0 in 0.615s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:15 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5 Sep 25 11:55:15 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Flow 'volume_create_manager' (e116d5d2-e219-485b-a62d-01ad74491101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8738f489-4764-4b34-b2f2-35a1bb557bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8738f489-4764-4b34-b2f2-35a1bb557bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949411907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a33cc5-8ea1-4df2-b272-da6b17e9295b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07110289bfda4d61965b366f228c9842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:16Z,use_quota=True,user_id='5658d51052914266ba871fa47dd03983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2bd32b-746b-4a67-9d03-e262e340e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2bd32b-746b-4a67-9d03-e262e340e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b58032-23c4-4235-be09-d9589df7bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b58032-23c4-4235-be09-d9589df7bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a33cc5-8ea1-4df2-b272-da6b17e9295b', 'volume_name': 'volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1746b1-1d46-4fef-ac38-1cee17d362e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1746b1-1d46-4fef-ac38-1cee17d362e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1e685b-0c0f-4a55-b06b-3c5b82a92273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Volume 76a33cc5-8ea1-4df2-b272-da6b17e9295b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b', 'volume_size': 1} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff.71f51154-2b25-4ae7-9157-1434cc3c7af5" returned: 0 in 0.529s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-71f51154-2b25-4ae7-9157-1434cc3c7af5" released by "_delete_snapshot" :: held 2.529s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" released by "delete_snapshot" :: held 2.565s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Created reservations ['b4d7610a-584e-484b-99f9-d51ecd11233c', '788d1cd7-109c-4fe0-a11f-d596a855d720', '35d2a925-eb6c-4789-9f69-8e7708b1a472', 'd33c36b5-3796-41a1-a15b-047b80d692aa'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:15 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f 1G" returned: 0 in 0.763s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b8adfe-584e-43e4-8763-6ff464bae759 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:16 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b8adfe-584e-43e4-8763-6ff464bae759 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f Sep 25 11:55:16 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:16 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-0fa932ca-97f1-408b-8add-80c8fb0ffa52 tempest-ProjectMemberTests-391203219 None] Lock "cinder-71f51154-2b25-4ae7-9157-1434cc3c7af5-delete_snapshot" released by "delete_snapshot" :: held 2.816s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:16 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b8adfe-584e-43e4-8763-6ff464bae759 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f" returned: 0 in 0.445s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:16 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f is being set with open permissions: ugo+rw Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:16 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f Sep 25 11:55:16 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-da23e6d7-e58d-4d68-9a14-52d232ffe3ff-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Lock "cinder-da23e6d7-e58d-4d68-9a14-52d232ffe3ff-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:16 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f" returned: 0 in 0.387s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" acquired by "delete_volume" :: waited 0.047s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:16 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.info Sep 25 11:55:16 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c94c0ff-bb0e-4527-a163-cf45b78c4b1d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:17 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff Sep 25 11:55:17 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:17 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.info" returned: 0 in 0.625s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:17 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.info is being set with open permissions: ugo+rw Sep 25 11:55:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:17 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.info Sep 25 11:55:17 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:17 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" returned: 0 in 0.790s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:17 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff Sep 25 11:55:17 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:17 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.info" returned: 0 in 0.477s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.202s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949411907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a33cc5-8ea1-4df2-b272-da6b17e9295b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07110289bfda4d61965b366f228c9842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:16Z,use_quota=True,user_id='5658d51052914266ba871fa47dd03983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Creating volume 76a33cc5-8ea1-4df2-b272-da6b17e9295b {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:18 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:18 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b 1073741824 Sep 25 11:55:18 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:18 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-bdf29fb3-b824-4741-a1bd-8276d187125d tempest-CinderUnicodeTest-628620605 None] Create snapshot completed successfully Sep 25 11:55:18 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" returned: 0 in 0.454s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-da23e6d7-e58d-4d68-9a14-52d232ffe3ff" released by "delete_volume" :: held 1.375s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Created reservations ['a1e1767f-3100-4e8b-a4c1-b1d753cf5b27', 'fb19a2c5-4e12-46ec-aaf7-9e9886c7bf7c', '9b23ecea-c1a6-4791-822e-6c60f292d974', '2c98c495-4a86-4881-b98d-c1b3735b35d2'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:18 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:18 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:18 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b 1073741824" returned: 0 in 0.720s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:18 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.328s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:18 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2e45ffd0-052a-47cf-9439-f803067ed5d6 tempest-ProjectMemberTests-391203219 None] Lock "cinder-da23e6d7-e58d-4d68-9a14-52d232ffe3ff-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:18 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b Sep 25 11:55:18 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "cinder-875aeb46-c7b2-4df3-b5bb-012e52a3ab0f-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-875aeb46-c7b2-4df3-b5bb-012e52a3ab0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "cinder-quobyte-55b8adfe-584e-43e4-8763-6ff464bae759" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-quobyte-55b8adfe-584e-43e4-8763-6ff464bae759" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "cinder-quobyte-875aeb46-c7b2-4df3-b5bb-012e52a3ab0f" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-quobyte-875aeb46-c7b2-4df3-b5bb-012e52a3ab0f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Deleting offline snapshot 875aeb46-c7b2-4df3-b5bb-012e52a3ab0f of volume 55b8adfe-584e-43e4-8763-6ff464bae759 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] snapshot_file for this snap is: volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8999e2a4-a73c-44da-ae53-4927755bb734]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:19 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b" returned: 0 in 0.531s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1e685b-0c0f-4a55-b06b-3c5b82a92273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f70494-3c39-408e-9726-b2597ad63d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Volume volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b (76a33cc5-8ea1-4df2-b272-da6b17e9295b): created successfully Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f70494-3c39-408e-9726-b2597ad63d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:19 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f Sep 25 11:55:19 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Flow 'volume_create_manager' (e116d5d2-e219-485b-a62d-01ad74491101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:19 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6e39ed8d-1ecc-4b1d-b406-0fe7c9e3abba tempest-ProjectReaderTests-1615976224 None] Created volume successfully. Sep 25 11:55:20 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f" returned: 0 in 0.809s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55b8adfe-584e-43e4-8763-6ff464bae759(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d97daf-de26-4f8e-b25a-d88f490a1f53]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (9942e3c5-1569-41c3-9800-5a167359556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52f0c98-e083-4fd9-88d0-ac51e9b343cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52f0c98-e083-4fd9-88d0-ac51e9b343cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076352883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27946e3f-8585-4a79-9b3d-e34753ed339e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:20Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8151db9d-c6ad-4d4a-bbd2-bf6b3fd1571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:20 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 Sep 25 11:55:20 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8151db9d-c6ad-4d4a-bbd2-bf6b3fd1571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42507a30-5b34-4bfb-8f1f-f451d274579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42507a30-5b34-4bfb-8f1f-f451d274579d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27946e3f-8585-4a79-9b3d-e34753ed339e', 'volume_name': 'volume-27946e3f-8585-4a79-9b3d-e34753ed339e', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cae7ef5-7766-40a2-8897-8396c811e033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cae7ef5-7766-40a2-8897-8396c811e033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8533ae-07ac-4502-bfca-51320e5fb10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Volume 27946e3f-8585-4a79-9b3d-e34753ed339e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27946e3f-8585-4a79-9b3d-e34753ed339e', 'volume_size': 1} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076352883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27946e3f-8585-4a79-9b3d-e34753ed339e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:20Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Creating volume 27946e3f-8585-4a79-9b3d-e34753ed339e {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:20 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:20 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e 1073741824 Sep 25 11:55:20 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Acquiring lock "cinder-76a33cc5-8ea1-4df2-b272-da6b17e9295b-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Lock "cinder-76a33cc5-8ea1-4df2-b272-da6b17e9295b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:20 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759" returned: 0 in 0.626s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:20 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f Sep 25 11:55:20 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Acquiring lock "cinder-quobyte-76a33cc5-8ea1-4df2-b272-da6b17e9295b" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Lock "cinder-quobyte-76a33cc5-8ea1-4df2-b272-da6b17e9295b" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fced932-478a-4b0b-9fb3-02f2196973c5]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:21 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b Sep 25 11:55:21 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:21 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e 1073741824" returned: 0 in 0.983s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:21 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e Sep 25 11:55:21 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:21 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b" returned: 0 in 0.701s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:21 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b Sep 25 11:55:21 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:21 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f" returned: 0 in 0.897s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:21 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f Sep 25 11:55:21 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:21 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e" returned: 0 in 0.381s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8533ae-07ac-4502-bfca-51320e5fb10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27946e3f-8585-4a79-9b3d-e34753ed339e', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e501217d-3ddf-46ef-93e2-b79aa98ff8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:21 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Volume volume-27946e3f-8585-4a79-9b3d-e34753ed339e (27946e3f-8585-4a79-9b3d-e34753ed339e): created successfully Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e501217d-3ddf-46ef-93e2-b79aa98ff8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:21 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (9942e3c5-1569-41c3-9800-5a167359556b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:21 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8f5fd561-8b5c-40b2-8517-a7d4ef05e9f2 tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:55:21 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759.875aeb46-c7b2-4df3-b5bb-012e52a3ab0f" returned: 0 in 0.336s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:22 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-76a33cc5-8ea1-4df2-b272-da6b17e9295b" returned: 0 in 0.429s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Lock "cinder-quobyte-76a33cc5-8ea1-4df2-b272-da6b17e9295b" released by "delete_volume" :: held 1.218s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-quobyte-875aeb46-c7b2-4df3-b5bb-012e52a3ab0f" released by "_delete_snapshot" :: held 2.925s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-quobyte-55b8adfe-584e-43e4-8763-6ff464bae759" released by "delete_snapshot" :: held 2.968s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Created reservations ['b1a870e5-fcfe-4c1e-800c-d6631a6acd6e', 'f889928c-78ea-43f3-b827-f59d96972c56', '56cfbd88-0d00-4e9d-97de-35dfc89d149b', '21deb27b-4d25-4438-9741-e4cb423ca461'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Created reservations ['55b6132c-0573-4d7c-aac0-81cd6ffcbad0', 'd5557c8e-653d-4f06-a2d6-ea647e00a4c6', 'c60aadb6-913f-4271-85a3-f1fec7832ee3', 'cfaf6c51-85e7-42b3-a03d-76b21eae5643'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:22 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Delete snapshot completed successfully. Sep 25 11:55:22 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c58e05c2-aece-491c-bf91-b604286543b2 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-875aeb46-c7b2-4df3-b5bb-012e52a3ab0f-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Creating offline snapshot d9e5c0bf-c8c9-4cad-96ed-1206a284e418 of volume 27946e3f-8585-4a79-9b3d-e34753ed339e {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Acquiring lock "cinder-55b8adfe-584e-43e4-8763-6ff464bae759-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6b95e2-85fc-48a2-aba9-0d00a3b9f866]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Lock "cinder-55b8adfe-584e-43e4-8763-6ff464bae759-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Acquiring lock "cinder-quobyte-55b8adfe-584e-43e4-8763-6ff464bae759" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Lock "cinder-quobyte-55b8adfe-584e-43e4-8763-6ff464bae759" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:22 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.441s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:22 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e Sep 25 11:55:22 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Deleted volume successfully. Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c390bb-0f16-47e7-98b1-ed30a97df2f8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7778d31e-6b6b-4e27-99a6-20f6dca5fc9b tempest-ProjectReaderTests-1615976224 None] Lock "cinder-76a33cc5-8ea1-4df2-b272-da6b17e9295b-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Flow 'volume_create_manager' (ff7b7e5a-6c89-4a62-95ab-54fb345caee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:22 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 Sep 25 11:55:22 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6c5077-9e89-4f75-a43f-2720c88fe4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6c5077-9e89-4f75-a43f-2720c88fe4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1016438220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a4c63a6203d4ebbab4d3d22d3125ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:23Z,use_quota=True,user_id='63da4ec515664309a2d38eae0b29a6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:22 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b60c539-0d25-45fe-ba6c-750ad49e366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b60c539-0d25-45fe-ba6c-750ad49e366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a673e261-ae9c-477c-8d75-f9448f3d247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a673e261-ae9c-477c-8d75-f9448f3d247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4', 'volume_name': 'volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c4ca93-d178-4167-b3d5-7c41d8fa060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c4ca93-d178-4167-b3d5-7c41d8fa060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda18c0a-7501-4d25-abe1-3a6030d8c302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Volume 9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4', 'volume_size': 1} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:23 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e" returned: 0 in 0.547s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:23 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 1G Sep 25 11:55:23 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:23 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759" returned: 0 in 0.595s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:23 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:23 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:23 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759 Sep 25 11:55:23 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:23 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Flow 'volume_create_manager' (436d2278-6b38-4f2b-b1e4-50db5cd8fafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5100c6-264b-4dae-a382-1772e08010fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.397s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:23 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:23 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 1G" returned: 0 in 0.662s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27946e3f-8585-4a79-9b3d-e34753ed339e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5100c6-264b-4dae-a382-1772e08010fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1125606610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b207962-504e-48f5-bd68-69f28b708a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07110289bfda4d61965b366f228c9842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:24Z,use_quota=True,user_id='5658d51052914266ba871fa47dd03983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc3dac1-d568-4b10-8252-bf12d348a202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc3dac1-d568-4b10-8252-bf12d348a202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:23 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27946e3f-8585-4a79-9b3d-e34753ed339e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 Sep 25 11:55:23 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585adc55-8584-40ff-bf9c-a6dc440cfcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585adc55-8584-40ff-bf9c-a6dc440cfcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b207962-504e-48f5-bd68-69f28b708a5f', 'volume_name': 'volume-7b207962-504e-48f5-bd68-69f28b708a5f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc05851f-c964-48f6-aa2c-4418da2f2ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc05851f-c964-48f6-aa2c-4418da2f2ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624af3dc-f0a1-44dc-8a65-480ae4dd09b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:23 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Volume 7b207962-504e-48f5-bd68-69f28b708a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b207962-504e-48f5-bd68-69f28b708a5f', 'volume_size': 1} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-55b8adfe-584e-43e4-8763-6ff464bae759" returned: 0 in 0.455s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Lock "cinder-quobyte-55b8adfe-584e-43e4-8763-6ff464bae759" released by "delete_volume" :: held 1.147s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:23 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Created reservations ['d3d93b3b-09b8-43e3-9e9c-550a36fe5ebe', '1838eef8-5109-40c1-be83-7c42eb40152c', '8d97b22b-0f04-4029-a85f-7ee8df4627d0', '0361f076-3539-4bcb-bcf3-360d1c62c341'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:24 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:24 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:24 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27946e3f-8585-4a79-9b3d-e34753ed339e -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418" returned: 0 in 0.367s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:24 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 is being set with open permissions: ugo+rw Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:24 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 Sep 25 11:55:24 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:24 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.273s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:24 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Deleted volume successfully. Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e488817b-f2bb-43f1-84d7-239b650134bc tempest-CinderUnicodeTest-628620605 None] Lock "cinder-55b8adfe-584e-43e4-8763-6ff464bae759-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:24 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418" returned: 0 in 0.268s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:24 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.info Sep 25 11:55:24 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:24 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.info" returned: 0 in 0.267s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:24 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.info is being set with open permissions: ugo+rw Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:24 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.info Sep 25 11:55:24 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "cinder-fd9021e9-1c08-4e67-9fd4-abc694cbc36f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-fd9021e9-1c08-4e67-9fd4-abc694cbc36f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:24 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.info" returned: 0 in 0.290s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.981s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1016438220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a4c63a6203d4ebbab4d3d22d3125ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:23Z,use_quota=True,user_id='63da4ec515664309a2d38eae0b29a6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Creating volume 9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:25 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:25 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 1073741824 Sep 25 11:55:25 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "cinder-quobyte-fd9021e9-1c08-4e67-9fd4-abc694cbc36f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e4196b7e-3025-4c77-8915-8fc14e3d4358 tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-quobyte-fd9021e9-1c08-4e67-9fd4-abc694cbc36f" acquired by "delete_volume" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf482743-9f24-4792-a4eb-d7bb411d4185]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:25 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f Sep 25 11:55:25 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-d9e5c0bf-c8c9-4cad-96ed-1206a284e418-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:25 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f" returned: 0 in 0.521s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:25 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 1073741824" returned: 0 in 0.659s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:25 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f Sep 25 11:55:25 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Lock "cinder-d9e5c0bf-c8c9-4cad-96ed-1206a284e418-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-27946e3f-8585-4a79-9b3d-e34753ed339e" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-27946e3f-8585-4a79-9b3d-e34753ed339e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-d9e5c0bf-c8c9-4cad-96ed-1206a284e418" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-d9e5c0bf-c8c9-4cad-96ed-1206a284e418" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot d9e5c0bf-c8c9-4cad-96ed-1206a284e418 of volume 27946e3f-8585-4a79-9b3d-e34753ed339e {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:55:25 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 Sep 25 11:55:25 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aae473-e461-4b54-9c80-aa162eaa5ebc]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:26 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 Sep 25 11:55:26 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:26 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-fd9021e9-1c08-4e67-9fd4-abc694cbc36f" returned: 0 in 0.429s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-quobyte-fd9021e9-1c08-4e67-9fd4-abc694cbc36f" released by "delete_volume" :: held 1.042s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:26 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" returned: 0 in 0.402s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.346s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1125606610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b207962-504e-48f5-bd68-69f28b708a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07110289bfda4d61965b366f228c9842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:24Z,use_quota=True,user_id='5658d51052914266ba871fa47dd03983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Creating volume 7b207962-504e-48f5-bd68-69f28b708a5f {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:26 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:26 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f 1073741824 Sep 25 11:55:26 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda18c0a-7501-4d25-abe1-3a6030d8c302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdd0607-a44d-4e03-8867-de02dcf1f426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:26 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Volume volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 (9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4): created successfully Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdd0607-a44d-4e03-8867-de02dcf1f426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Flow 'volume_create_manager' (ff7b7e5a-6c89-4a62-95ab-54fb345caee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2ebb71d0-08b8-4401-b1b1-cac7e7a2f2b1 tempest-SnapshotDependencyTests-2099168673 None] Created volume successfully. Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Created reservations ['210a91f6-10f3-4627-b652-b073b3777dee', '25aa27ad-4270-4046-9099-ee4fb5b237e6', 'a2b701ac-8fea-4649-bacc-2ca402c484b2', '149f7594-2d21-455a-8aa4-d11baaff1d9f'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:26 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418" returned: 0 in 0.623s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27946e3f-8585-4a79-9b3d-e34753ed339e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:26 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:26 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a92548a-84f2-411b-897b-a09f4e6df905]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:26 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e Sep 25 11:55:26 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:26 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.344s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Deleted volume successfully. Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-dfc5a1e6-8201-4241-a8db-5413dfd545a0 tempest-CinderUnicodeTest-628620605 None] Lock "cinder-fd9021e9-1c08-4e67-9fd4-abc694cbc36f-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:26 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f 1073741824" returned: 0 in 0.717s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:26 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f Sep 25 11:55:26 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:27 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e" returned: 0 in 0.514s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:27 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 Sep 25 11:55:27 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:27 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f" returned: 0 in 0.327s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624af3dc-f0a1-44dc-8a65-480ae4dd09b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b207962-504e-48f5-bd68-69f28b708a5f', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3742825-f988-4ffa-90c5-fc6a2db5331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:27 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Volume volume-7b207962-504e-48f5-bd68-69f28b708a5f (7b207962-504e-48f5-bd68-69f28b708a5f): created successfully Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3742825-f988-4ffa-90c5-fc6a2db5331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Flow 'volume_create_manager' (436d2278-6b38-4f2b-b1e4-50db5cd8fafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:27 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b3653c24-1ef0-41d2-913f-ec7c2ac8cd6e tempest-ProjectReaderTests-1615976224 None] Created volume successfully. Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Creating offline snapshot 890ad1e1-816b-4209-93c3-c6b96fb827b4 of volume 9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac15c2b5-cecb-4c47-9633-0503b21b0f7b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:27 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418" returned: 0 in 0.559s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:27 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418 Sep 25 11:55:27 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:27 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 Sep 25 11:55:27 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:27 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e.d9e5c0bf-c8c9-4cad-96ed-1206a284e418" returned: 0 in 0.357s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-d9e5c0bf-c8c9-4cad-96ed-1206a284e418" released by "_delete_snapshot" :: held 2.268s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-27946e3f-8585-4a79-9b3d-e34753ed339e" released by "delete_snapshot" :: held 2.310s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:28 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "cinder-7b207962-504e-48f5-bd68-69f28b708a5f-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" returned: 0 in 0.535s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-7b207962-504e-48f5-bd68-69f28b708a5f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:28 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 1G Sep 25 11:55:28 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Created reservations ['6bfaf454-24f0-45e7-aaed-37f1cd18a5b6', '347a38ea-b36d-42b9-9851-5400a4fde8c8', '5647523c-7a50-4e67-b526-d398b342149c', 'b3f0ad6c-8d3d-42be-b13a-e784375502f0'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "cinder-quobyte-7b207962-504e-48f5-bd68-69f28b708a5f" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-quobyte-7b207962-504e-48f5-bd68-69f28b708a5f" acquired by "delete_volume" :: waited 0.036s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f668031-513a-4a62-bdb1-e0b3b3029a2f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:28 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-337e9067-3f69-4305-8559-ccdce236f792 tempest-ProjectMemberTests-391203219 None] Lock "cinder-d9e5c0bf-c8c9-4cad-96ed-1206a284e418-delete_snapshot" released by "delete_snapshot" :: held 2.693s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:28 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f Sep 25 11:55:28 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:28 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 1G" returned: 0 in 0.678s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:28 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 Sep 25 11:55:28 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:29 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-27946e3f-8585-4a79-9b3d-e34753ed339e-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f" returned: 0 in 0.659s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Lock "cinder-27946e3f-8585-4a79-9b3d-e34753ed339e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:29 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f Sep 25 11:55:29 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-27946e3f-8585-4a79-9b3d-e34753ed339e" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-27946e3f-8585-4a79-9b3d-e34753ed339e" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5898ca4b-b262-45bb-9e94-68e0b0bc9b2c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:29 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4" returned: 0 in 0.477s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:29 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 is being set with open permissions: ugo+rw Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:29 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 Sep 25 11:55:29 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:29 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e Sep 25 11:55:29 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:29 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-7b207962-504e-48f5-bd68-69f28b708a5f" returned: 0 in 0.463s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-quobyte-7b207962-504e-48f5-bd68-69f28b708a5f" released by "delete_volume" :: held 1.219s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Created reservations ['60e370df-edb3-429c-a876-fa4329557212', 'ded0f8a9-9621-419f-8fb9-da6249376495', '9455e1a0-9e30-4f30-be48-403a84933ce7', 'cc1f3ee2-652b-47d1-a2a0-51f305a3581a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:29 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4" returned: 0 in 0.385s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:29 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e" returned: 0 in 0.529s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:29 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:29 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:29 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e Sep 25 11:55:29 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:29 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.info Sep 25 11:55:29 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:30 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.323s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:30 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Deleted volume successfully. Sep 25 11:55:30 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-27946e3f-8585-4a79-9b3d-e34753ed339e" returned: 0 in 0.338s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:30 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.info" returned: 0 in 0.323s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:30 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.info is being set with open permissions: ugo+rw Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-b744b40e-94f9-429a-aa82-878a4ede1ef8 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-7b207962-504e-48f5-bd68-69f28b708a5f-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-27946e3f-8585-4a79-9b3d-e34753ed339e" released by "delete_volume" :: held 0.980s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:30 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.info Sep 25 11:55:30 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Created reservations ['d82bd812-f3d0-44e4-b979-ddd4260e7226', '062e7265-0fad-442f-814d-95bb1bda9199', 'e9ac1b8d-6577-4a3f-82b4-f6bae08aa4b6', 'b451b774-9fe7-4326-a91c-78e0e18ddfe8'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:30 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:30 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:30 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.info" returned: 0 in 0.392s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.957s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:30 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-71a542a6-2954-41d0-aa1d-55db04c68ac3 tempest-SnapshotDependencyTests-2099168673 None] Create snapshot completed successfully Sep 25 11:55:30 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.387s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:30 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:55:30 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-eac8c36f-e5bf-4f6b-9c9a-eb6775b23673 tempest-ProjectMemberTests-391203219 None] Lock "cinder-27946e3f-8585-4a79-9b3d-e34753ed339e-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Flow 'volume_create_manager' (96ba07fd-f97d-4ade-bca8-078743c76f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14083e2-cc0a-4e1e-9ad3-fdbc8737d05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14083e2-cc0a-4e1e-9ad3-fdbc8737d05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241505755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2d300b-53f6-4a55-b221-dbec612450d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07110289bfda4d61965b366f228c9842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:31Z,use_quota=True,user_id='5658d51052914266ba871fa47dd03983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435d3fe1-6b81-4514-b1e1-a84164e1fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435d3fe1-6b81-4514-b1e1-a84164e1fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c806376-a7fc-4ce5-9cc6-f1e62fd0caf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c806376-a7fc-4ce5-9cc6-f1e62fd0caf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2d300b-53f6-4a55-b221-dbec612450d4', 'volume_name': 'volume-8c2d300b-53f6-4a55-b221-dbec612450d4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc6541d-feb1-48a1-9de7-f7b3fc549990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc6541d-feb1-48a1-9de7-f7b3fc549990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5e05e1-6507-4ca4-8eb3-a47cef58e610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Volume 8c2d300b-53f6-4a55-b221-dbec612450d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2d300b-53f6-4a55-b221-dbec612450d4', 'volume_size': 1} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241505755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2d300b-53f6-4a55-b221-dbec612450d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07110289bfda4d61965b366f228c9842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:31Z,use_quota=True,user_id='5658d51052914266ba871fa47dd03983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Creating volume 8c2d300b-53f6-4a55-b221-dbec612450d4 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:31 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:31 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 1073741824 Sep 25 11:55:31 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Flow 'volume_create_manager' (7de8410b-0963-4c6c-b2b2-f74ae3b2946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4003ac43-0af0-44aa-aac4-344d13192472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4003ac43-0af0-44aa-aac4-344d13192472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee15621-44ec-4554-b6d9-0ec1bc6d5f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a4c63a6203d4ebbab4d3d22d3125ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=890ad1e1-816b-4209-93c3-c6b96fb827b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:32Z,use_quota=True,user_id='63da4ec515664309a2d38eae0b29a6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdf7c7b-8bf5-4aef-a451-0dcc18073ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdf7c7b-8bf5-4aef-a451-0dcc18073ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654ac418-2317-4a26-b34d-4513e53dba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654ac418-2317-4a26-b34d-4513e53dba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aee15621-44ec-4554-b6d9-0ec1bc6d5f65', 'volume_name': 'volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65', 'volume_size': 1, 'snapshot_id': '890ad1e1-816b-4209-93c3-c6b96fb827b4'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb39277-8b17-4c16-9194-8dd7b51b39b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb39277-8b17-4c16-9194-8dd7b51b39b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2359538-4c1b-4cbd-8aba-7d2591682bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Volume aee15621-44ec-4554-b6d9-0ec1bc6d5f65: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65', 'volume_size': 1, 'snapshot_id': '890ad1e1-816b-4209-93c3-c6b96fb827b4'} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:31 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 1073741824" returned: 0 in 0.702s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (8e4f0300-c13e-4ee7-a48b-5be943d3fabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae8298d-1d88-42cd-8859-3fdb7f20c8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae8298d-1d88-42cd-8859-3fdb7f20c8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1911648770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852af5e8-d4b0-4c5b-b559-9e0725622d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:32Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9940400b-6b21-43ab-bd5d-a3f1edd72e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9940400b-6b21-43ab-bd5d-a3f1edd72e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:32 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 Sep 25 11:55:32 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68180d2-a779-4cd8-bf5f-f1a1e9779b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68180d2-a779-4cd8-bf5f-f1a1e9779b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852af5e8-d4b0-4c5b-b559-9e0725622d3d', 'volume_name': 'volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4dab5a7-3ad0-4685-af10-4afe6e78ab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4dab5a7-3ad0-4685-af10-4afe6e78ab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59343531-ae5a-423d-8012-364adb1d4ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:32 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Volume 852af5e8-d4b0-4c5b-b559-9e0725622d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d', 'volume_size': 1} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:32 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4" returned: 0 in 0.331s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.517s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-quobyte-890ad1e1-816b-4209-93c3-c6b96fb827b4-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" by "_create_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5e05e1-6507-4ca4-8eb3-a47cef58e610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2d300b-53f6-4a55-b221-dbec612450d4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd244d73-8f5b-4018-a3b5-cc3cf95226af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-890ad1e1-816b-4209-93c3-c6b96fb827b4-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Creating volume aee15621-44ec-4554-b6d9-0ec1bc6d5f65 from snapshot 890ad1e1-816b-4209-93c3-c6b96fb827b4 {{(pid=87356) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-quobyte-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" by "_copy_volume_from_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:32 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Volume volume-8c2d300b-53f6-4a55-b221-dbec612450d4 (8c2d300b-53f6-4a55-b221-dbec612450d4): created successfully Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd244d73-8f5b-4018-a3b5-cc3cf95226af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Flow 'volume_create_manager' (96ba07fd-f97d-4ade-bca8-078743c76f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] snapshot: 890ad1e1-816b-4209-93c3-c6b96fb827b4, volume: aee15621-44ec-4554-b6d9-0ec1bc6d5f65, {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:55:32 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c0494970-3d58-42b3-b2d2-3caeb2f20b80 tempest-ProjectReaderTests-1615976224 None] Created volume successfully. Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33dd795-91ff-4668-bac5-cf36ff78d69a]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:32 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 Sep 25 11:55:32 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:32 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4" returned: 0 in 0.425s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bb20e4-ba79-4061-ba13-113c2074e987]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:33 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 Sep 25 11:55:33 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "cinder-8c2d300b-53f6-4a55-b221-dbec612450d4-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-8c2d300b-53f6-4a55-b221-dbec612450d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "cinder-quobyte-8c2d300b-53f6-4a55-b221-dbec612450d4" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-quobyte-8c2d300b-53f6-4a55-b221-dbec612450d4" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e11388-8172-4807-bf9c-3e6bc5bb0994]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:33 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" returned: 0 in 0.540s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Creating direct copy from snapshot {{(pid=87356) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG cinder.utils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Path /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 not found in is_blk_device check {{(pid=87356) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:33 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 Sep 25 11:55:33 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:33 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 Sep 25 11:55:33 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:33 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4" returned: 0 in 0.412s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:33 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4 Sep 25 11:55:33 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:34 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-8c2d300b-53f6-4a55-b221-dbec612450d4" returned: 0 in 0.379s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-quobyte-8c2d300b-53f6-4a55-b221-dbec612450d4" released by "delete_volume" :: held 0.859s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Created reservations ['ae07d3e7-d7d0-4f58-be47-41ba7a97613f', 'e019d902-fdd1-4357-88c2-e71ef19c6916', '3c1bbaca-fcb6-4c80-b796-d21eef6d75ed', '861f0bdf-6c74-4d73-8bb4-b08bc78aa107'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:34 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:34 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:35 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.510s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:35 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:35 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Deleted volume successfully. Sep 25 11:55:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-610bf9ad-2d0e-4ccf-8a4d-dd284a29e347 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-8c2d300b-53f6-4a55-b221-dbec612450d4-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Flow 'volume_create_manager' (847b436e-57e9-4ea3-8d90-eb18d3bc0a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2cadd5-bcb8-4b55-8ad5-d050b3084690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2cadd5-bcb8-4b55-8ad5-d050b3084690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464841730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07110289bfda4d61965b366f228c9842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:36Z,use_quota=True,user_id='5658d51052914266ba871fa47dd03983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0804570e-b9a8-4694-94e2-97ae4e985efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0804570e-b9a8-4694-94e2-97ae4e985efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e564b2-184c-4428-90c7-933190d1c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e564b2-184c-4428-90c7-933190d1c1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7', 'volume_name': 'volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a3e06e-a4f7-480b-b16c-b29d64fc0e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a3e06e-a4f7-480b-b16c-b29d64fc0e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8438952-35e2-4134-8ef5-ae0b530be865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:36 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Volume 07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7', 'volume_size': 1} Sep 25 11:55:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:40 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" returned: 0 in 6.891s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.image.image_utils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 {{(pid=87356) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:55:40 devstack cinder-volume[87356]: INFO cinder.image.image_utils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Converted 1024.00 MB image at 148.55 MB/s Sep 25 11:55:40 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 is being set with open permissions: ugo+rw Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:40 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 Sep 25 11:55:40 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:40 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" returned: 0 in 0.245s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" released by "_copy_volume_from_snapshot" :: held 8.260s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-890ad1e1-816b-4209-93c3-c6b96fb827b4-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" released by "_create_volume_from_snapshot" :: held 8.339s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.374s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.626s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1911648770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852af5e8-d4b0-4c5b-b559-9e0725622d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:32Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Creating volume 852af5e8-d4b0-4c5b-b559-9e0725622d3d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:40 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:40 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d 1073741824 Sep 25 11:55:40 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2359538-4c1b-4cbd-8aba-7d2591682bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65', 'volume_size': 1, 'snapshot_id': '890ad1e1-816b-4209-93c3-c6b96fb827b4'}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1591a98b-8579-48ab-b29d-d59c1a01e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:40 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Volume volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 (aee15621-44ec-4554-b6d9-0ec1bc6d5f65): created successfully Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1591a98b-8579-48ab-b29d-d59c1a01e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:40 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Flow 'volume_create_manager' (7de8410b-0963-4c6c-b2b2-f74ae3b2946e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:40 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e157da9b-2015-47d6-b60e-54d857cf043a tempest-SnapshotDependencyTests-2099168673 None] Created volume successfully. Sep 25 11:55:41 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d 1073741824" returned: 0 in 0.441s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:41 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d Sep 25 11:55:41 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:41 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d" returned: 0 in 0.257s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.999s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464841730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07110289bfda4d61965b366f228c9842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:36Z,use_quota=True,user_id='5658d51052914266ba871fa47dd03983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Creating volume 07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:41 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59343531-ae5a-423d-8012-364adb1d4ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:41 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 1073741824 Sep 25 11:55:41 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1de176-182f-496c-b6b6-be610869353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:41 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Volume volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d (852af5e8-d4b0-4c5b-b559-9e0725622d3d): created successfully Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1de176-182f-496c-b6b6-be610869353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (8e4f0300-c13e-4ee7-a48b-5be943d3fabf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:41 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f6e39ed7-fc13-423d-bc4f-423656b3f8a8 tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-890ad1e1-816b-4209-93c3-c6b96fb827b4-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-890ad1e1-816b-4209-93c3-c6b96fb827b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-quobyte-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-quobyte-890ad1e1-816b-4209-93c3-c6b96fb827b4" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-890ad1e1-816b-4209-93c3-c6b96fb827b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Deleting offline snapshot 890ad1e1-816b-4209-93c3-c6b96fb827b4 of volume 9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] snapshot_file for this snap is: volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c11ed-1760-46f7-9d00-2a11cc65b12c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:41 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 Sep 25 11:55:41 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:42 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 1073741824" returned: 0 in 0.602s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:42 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4" returned: 0 in 0.442s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:42 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 Sep 25 11:55:42 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681e974-1995-4b34-b2ac-60efad34d97d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:42 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 Sep 25 11:55:42 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:42 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7" returned: 0 in 0.281s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.327s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8438952-35e2-4134-8ef5-ae0b530be865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593d1848-750f-4a2e-b8f2-dbbf4a64a40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Creating offline snapshot ab48492e-ed25-4e01-a337-ade2164404d1 of volume 852af5e8-d4b0-4c5b-b559-9e0725622d3d {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:55:42 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Volume volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 (07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7): created successfully Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593d1848-750f-4a2e-b8f2-dbbf4a64a40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Flow 'volume_create_manager' (847b436e-57e9-4ea3-8d90-eb18d3bc0a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30253b2-cf17-4889-8855-be4758cf89c9]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:42 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-1c57314b-257f-4dd9-9333-dfe8d369e651 tempest-ProjectReaderTests-1615976224 None] Created volume successfully. Sep 25 11:55:42 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d Sep 25 11:55:42 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:42 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" returned: 0 in 0.609s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:42 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 Sep 25 11:55:42 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:42 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d" returned: 0 in 0.493s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:42 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 1G Sep 25 11:55:42 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:43 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4" returned: 0 in 0.448s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:43 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4 Sep 25 11:55:43 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "cinder-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:43 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4.890ad1e1-816b-4209-93c3-c6b96fb827b4" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "cinder-quobyte-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:43 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-quobyte-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7" acquired by "delete_volume" :: waited 0.050s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 1G" returned: 0 in 0.684s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-890ad1e1-816b-4209-93c3-c6b96fb827b4" released by "_delete_snapshot" :: held 2.015s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab0a725-07d4-4a59-9de2-b757f9982604]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:43 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 Sep 25 11:55:43 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" released by "delete_snapshot" :: held 2.052s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Created reservations ['bba1ce46-5ddb-4974-a6dd-8a1556a14836', '25b29abe-792f-4ced-854c-28fb0a888976', '0070b6d6-b474-4b53-bbda-c0587b1fbd1e', '477c2e71-7d06-4920-b3e3-ea4087d9388d'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:43 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 Sep 25 11:55:43 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:43 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Delete snapshot completed successfully. Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-d3666aff-2a00-41fe-be16-5bf0e9a7847e tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-890ad1e1-816b-4209-93c3-c6b96fb827b4-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:43 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:43 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 is being set with open permissions: ugo+rw Sep 25 11:55:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:44 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 Sep 25 11:55:44 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:44 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7" returned: 0 in 0.446s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:44 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7 Sep 25 11:55:44 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:44 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1" returned: 0 in 0.356s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:UPDATE=179,cinder:SELECT=137,cinder:INSERT=48,cinder:DELETE=13 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:INSERT=45,cinder:UPDATE=196,cinder:SELECT=144,cinder:DELETE=17 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:44 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.info Sep 25 11:55:44 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:44 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7" returned: 0 in 0.359s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-quobyte-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7" released by "delete_volume" :: held 0.866s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Created reservations ['a45f03da-9159-48d8-a417-5c4ab7cf425e', 'a1fdc9ff-e73b-4ca9-93dc-03208b28a6d7', '5d4dcc6f-b4d4-41e1-8955-39a6dfe3160d', 'bd81d6ca-5a47-40b5-8d9c-885b46267638'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:44 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:44 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:44 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.info" returned: 0 in 0.336s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:44 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.info is being set with open permissions: ugo+rw Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:44 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.info Sep 25 11:55:44 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-quobyte-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:45 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.402s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Deleted volume successfully. Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[73da945e-d6ef-46cb-a45a-89483b255628]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ddad98cf-02f1-4f20-8afa-1ba08963b3b0 tempest-ProjectReaderTests-1615976224 None] Lock "cinder-07cd9e5f-8c5c-4a9e-94cb-2fa7a9e567b7-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:45 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.info" returned: 0 in 0.470s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:45 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 Sep 25 11:55:45 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-88e49177-20e9-4642-8b92-ad36bcd35766 tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:55:45 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" returned: 0 in 0.463s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:45 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4 Sep 25 11:55:45 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:45 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" returned: 0 in 0.277s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4" released by "delete_volume" :: held 0.843s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:45 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Created reservations ['ca6cd4f2-662f-4877-9832-a0e35142bbe8', '462180c9-45d2-4cbc-bc0e-f15acbe121d8', 'bc42de6e-d486-4e5e-a485-e7a56e4e57de', '692f4fda-e204-4220-b100-9348d3ad0bd1'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:46 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:46 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-aee15621-44ec-4554-b6d9-0ec1bc6d5f65-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-aee15621-44ec-4554-b6d9-0ec1bc6d5f65-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "cinder-quobyte-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" acquired by "delete_volume" :: waited 0.031s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca861c9-dafd-4044-aec1-5eb5559a726c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-ab48492e-ed25-4e01-a337-ade2164404d1-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:46 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.361s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Lock "cinder-ab48492e-ed25-4e01-a337-ade2164404d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-852af5e8-d4b0-4c5b-b559-9e0725622d3d" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:46 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Deleted volume successfully. Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-852af5e8-d4b0-4c5b-b559-9e0725622d3d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-ab48492e-ed25-4e01-a337-ade2164404d1" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-18f76fc3-f53f-4df0-b90e-b276df9583b2 tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-9dfcd006-ec25-40ce-b7f9-2e4fb02a52d4-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-ab48492e-ed25-4e01-a337-ade2164404d1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot ab48492e-ed25-4e01-a337-ade2164404d1 of volume 852af5e8-d4b0-4c5b-b559-9e0725622d3d {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[19de098a-9dca-4388-b9e8-e44a87b401b3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:46 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 Sep 25 11:55:46 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:46 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 Sep 25 11:55:46 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:46 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" returned: 0 in 0.520s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:46 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65 Sep 25 11:55:46 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:46 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1" returned: 0 in 0.493s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:46 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[24166f98-4b2b-4852-8375-e6c4ab799a3d]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:47 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d Sep 25 11:55:47 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:47 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" returned: 0 in 0.349s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-quobyte-aee15621-44ec-4554-b6d9-0ec1bc6d5f65" released by "delete_volume" :: held 0.946s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Created reservations ['f1ac61c3-0bc8-4bac-b5cc-2ecb3165d3db', '2c4739a3-82d7-4ca3-bab9-cd75b86004d2', '21527772-77d7-4c06-8aa5-d8b69a2ebb91', 'e114210a-4011-40a8-83c3-9dc9ef37d0b7'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:47 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:47 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:47 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d" returned: 0 in 0.454s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:47 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 Sep 25 11:55:47 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:47 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.278s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:47 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Deleted volume successfully. Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64519e70-68e9-4409-81cd-a0db4c3a0af2 tempest-SnapshotDependencyTests-2099168673 None] Lock "cinder-aee15621-44ec-4554-b6d9-0ec1bc6d5f65-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:47 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1" returned: 0 in 0.357s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:47 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:47 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1 Sep 25 11:55:47 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:48 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d.ab48492e-ed25-4e01-a337-ade2164404d1" returned: 0 in 0.286s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-ab48492e-ed25-4e01-a337-ade2164404d1" released by "_delete_snapshot" :: held 1.717s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-852af5e8-d4b0-4c5b-b559-9e0725622d3d" released by "delete_snapshot" :: held 1.756s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Created reservations ['eb4eaa78-d43b-4969-ab2b-b110a0478620', 'c71f28ce-4a73-40c3-9af4-2f2b7ee131a7', '05291667-d9f1-47b4-940d-153716d43ed8', 'cac6fe4a-c8a8-4575-be3f-8a5ca243decb'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:48 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-47451b8a-e294-4e83-b544-540bb79fb21f tempest-ProjectMemberTests-391203219 None] Lock "cinder-ab48492e-ed25-4e01-a337-ade2164404d1-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-852af5e8-d4b0-4c5b-b559-9e0725622d3d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Lock "cinder-852af5e8-d4b0-4c5b-b559-9e0725622d3d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-852af5e8-d4b0-4c5b-b559-9e0725622d3d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-852af5e8-d4b0-4c5b-b559-9e0725622d3d" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[198f97b7-4653-4bb1-82e6-2b2abbe9596b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:48 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:48 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d Sep 25 11:55:48 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:49 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d" returned: 0 in 0.414s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:49 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d Sep 25 11:55:49 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:49 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852af5e8-d4b0-4c5b-b559-9e0725622d3d" returned: 0 in 0.318s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-852af5e8-d4b0-4c5b-b559-9e0725622d3d" released by "delete_volume" :: held 0.817s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Created reservations ['edec925c-5987-48ad-a920-178dd881d509', '3254a3f9-d331-4bed-acae-64bbf259a836', 'e368626c-1260-4e88-9549-4ce980d0659b', 'fde5b00e-e5c5-4e6d-a209-4ca4e53041a2'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:49 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:49 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:49 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.264s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:49 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:55:49 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-fc615e15-3a23-45ab-a23f-b48405fea25e tempest-ProjectMemberTests-391203219 None] Lock "cinder-852af5e8-d4b0-4c5b-b559-9e0725622d3d-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (dafa68c1-c63e-4502-9dea-2b81738e2cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46656a4b-b9a6-4c25-9308-f99bb3e140f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46656a4b-b9a6-4c25-9308-f99bb3e140f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290024840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:50Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a550452c-47c6-4ed3-bf0d-b65b50464f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a550452c-47c6-4ed3-bf0d-b65b50464f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fa2def-d9ef-4826-bd0b-a3e84f8fae37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fa2def-d9ef-4826-bd0b-a3e84f8fae37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4', 'volume_name': 'volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5becba-7e33-4fb9-b04a-4dbdb1958c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5becba-7e33-4fb9-b04a-4dbdb1958c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ab1e92-3ba7-4378-bc49-6cbfbb83bf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:50 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Volume f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4', 'volume_size': 1} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290024840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:50Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Creating volume f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:50 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:50 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 1073741824 Sep 25 11:55:50 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:50 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 1073741824" returned: 0 in 0.483s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:50 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 Sep 25 11:55:50 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:51 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" returned: 0 in 0.353s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ab1e92-3ba7-4378-bc49-6cbfbb83bf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5f738d-7612-4e6b-ac0a-720d8467b2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:51 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Volume volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 (f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4): created successfully Sep 25 11:55:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5f738d-7612-4e6b-ac0a-720d8467b2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (dafa68c1-c63e-4502-9dea-2b81738e2cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:51 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-86e6f4ab-759f-4993-a739-fbea4e077e89 tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:55:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Creating offline snapshot 735bf815-fd92-4832-a623-f2b96737f7c5 of volume f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:55:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db3c550-7b46-47b0-8632-2aeda2a55928]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:52 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 Sep 25 11:55:52 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:53 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" returned: 0 in 0.485s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:53 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 1G Sep 25 11:55:53 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:53 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 1G" returned: 0 in 0.484s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:53 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 Sep 25 11:55:53 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:54 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5" returned: 0 in 0.382s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:54 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 is being set with open permissions: ugo+rw Sep 25 11:55:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:54 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 Sep 25 11:55:54 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:54 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5" returned: 0 in 0.314s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:54 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.info Sep 25 11:55:54 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:54 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.info" returned: 0 in 0.299s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:54 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.info is being set with open permissions: ugo+rw Sep 25 11:55:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:54 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.info Sep 25 11:55:54 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:55 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.info" returned: 0 in 0.292s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c7b2518a-7d98-4226-a30d-18abf8374e0e tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-735bf815-fd92-4832-a623-f2b96737f7c5-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Lock "cinder-735bf815-fd92-4832-a623-f2b96737f7c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-735bf815-fd92-4832-a623-f2b96737f7c5" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-735bf815-fd92-4832-a623-f2b96737f7c5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot 735bf815-fd92-4832-a623-f2b96737f7c5 of volume f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c9a7b8-bff1-4525-9b44-d68c4514e811]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:56 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 Sep 25 11:55:56 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:56 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5" returned: 0 in 0.450s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[104f8f65-66b3-45bd-86bc-8099a10e4e56]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:56 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 Sep 25 11:55:56 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:56 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" returned: 0 in 0.524s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:57 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 Sep 25 11:55:57 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:57 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5" returned: 0 in 0.406s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:57 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5 Sep 25 11:55:57 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:57 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4.735bf815-fd92-4832-a623-f2b96737f7c5" returned: 0 in 0.330s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-735bf815-fd92-4832-a623-f2b96737f7c5" released by "_delete_snapshot" :: held 1.840s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" released by "delete_snapshot" :: held 1.868s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:57 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Created reservations ['6ac4aa57-3848-46d6-a2cf-d00fc84564f9', '1af41960-3314-4c04-be8e-1f49ea948382', '5cfa40aa-5ad0-4fc8-b49a-6b55d08119d3', '7bfbbe84-d930-4ed4-9781-1f9cc3086877'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:57 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:55:57 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-39ecade7-5ca7-4950-86a5-f74a684faee1 tempest-ProjectMemberTests-391203219 None] Lock "cinder-735bf815-fd92-4832-a623-f2b96737f7c5-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Lock "cinder-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:58 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b91a2b-d541-43d4-94d2-0d6df47ec8d8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:58 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 Sep 25 11:55:58 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:58 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" returned: 0 in 0.433s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:58 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4 Sep 25 11:55:58 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:59 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" returned: 0 in 0.343s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4" released by "delete_volume" :: held 0.876s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Created reservations ['c07349bb-3490-4720-9eed-aa3198c2c4b6', '0b0deedb-8055-415d-9b19-2f331a3d80a3', '2f7c994b-b2c3-4100-b6f7-9d702a988934', 'fe32695a-1479-4fb4-9c9e-e7b2263ddd79'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:59 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:55:59 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:59 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.314s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:59 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:55:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-757bafd6-51cf-4072-bb07-6f26e0ce685d tempest-ProjectMemberTests-391203219 None] Lock "cinder-f3c0b7c6-37bc-4f50-b574-8b0b068ca1b4-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (036a9ba2-7003-4ee1-85dc-4485f57264e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd3851b-6129-4c93-ba5f-e08a27ba0af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd3851b-6129-4c93-ba5f-e08a27ba0af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824609245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422e5c90-4e10-4a3b-86ae-03a56d1cc2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:00Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5750df-6f36-4566-aed3-b4bfc82ee588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5750df-6f36-4566-aed3-b4bfc82ee588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2926d4c6-1ee7-4873-81a8-1b65d2d4fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2926d4c6-1ee7-4873-81a8-1b65d2d4fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422e5c90-4e10-4a3b-86ae-03a56d1cc2ef', 'volume_name': 'volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971b3ea9-8d29-47cb-a820-7fea60aceb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971b3ea9-8d29-47cb-a820-7fea60aceb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70c7306-b301-4870-ab17-b0a0a52907bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Volume 422e5c90-4e10-4a3b-86ae-03a56d1cc2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef', 'volume_size': 1} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824609245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422e5c90-4e10-4a3b-86ae-03a56d1cc2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:00Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Creating volume 422e5c90-4e10-4a3b-86ae-03a56d1cc2ef {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:00 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:00 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef 1073741824 Sep 25 11:56:00 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:00 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef 1073741824" returned: 0 in 0.590s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:00 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef Sep 25 11:56:00 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:01 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" returned: 0 in 0.292s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70c7306-b301-4870-ab17-b0a0a52907bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1520634d-69f0-4641-9909-e7b5af9b7685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Volume volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef (422e5c90-4e10-4a3b-86ae-03a56d1cc2ef): created successfully Sep 25 11:56:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1520634d-69f0-4641-9909-e7b5af9b7685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (036a9ba2-7003-4ee1-85dc-4485f57264e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:01 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-108e442d-6087-48ea-9c29-415ded1abfc0 tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:56:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Creating offline snapshot 50faba10-e014-4e60-abbc-b880525e4ffd of volume 422e5c90-4e10-4a3b-86ae-03a56d1cc2ef {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:56:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4607641-d72d-4bad-b5a8-9990d1aee9aa]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:02 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef Sep 25 11:56:02 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:02 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" returned: 0 in 0.416s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:02 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd 1G Sep 25 11:56:02 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:03 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd 1G" returned: 0 in 0.442s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:03 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd Sep 25 11:56:03 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:03 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd" returned: 0 in 0.361s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:03 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd is being set with open permissions: ugo+rw Sep 25 11:56:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:03 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd Sep 25 11:56:03 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:03 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd" returned: 0 in 0.307s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:03 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.info Sep 25 11:56:03 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:04 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.info" returned: 0 in 0.346s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:04 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.info is being set with open permissions: ugo+rw Sep 25 11:56:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:04 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.info Sep 25 11:56:04 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:04 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.info" returned: 0 in 0.314s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-356e34d7-7579-4c89-845d-86187120db01 tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-50faba10-e014-4e60-abbc-b880525e4ffd-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Lock "cinder-50faba10-e014-4e60-abbc-b880525e4ffd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-50faba10-e014-4e60-abbc-b880525e4ffd" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-50faba10-e014-4e60-abbc-b880525e4ffd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot 50faba10-e014-4e60-abbc-b880525e4ffd of volume 422e5c90-4e10-4a3b-86ae-03a56d1cc2ef {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f0a15-f1b8-4510-906f-ddac35df23fe]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:05 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd Sep 25 11:56:05 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:06 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd" returned: 0 in 0.443s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:56:06 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c1de24-be80-4371-969f-4c4b929c1a3b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:06 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef Sep 25 11:56:06 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:06 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" returned: 0 in 0.430s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:06 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd Sep 25 11:56:06 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:06 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd" returned: 0 in 0.387s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:06 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd Sep 25 11:56:06 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:07 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef.50faba10-e014-4e60-abbc-b880525e4ffd" returned: 0 in 0.319s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-50faba10-e014-4e60-abbc-b880525e4ffd" released by "_delete_snapshot" :: held 1.703s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" released by "delete_snapshot" :: held 1.735s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Created reservations ['efab555c-ef78-42dc-9c79-0f9c478a0bf8', 'e73727f8-4002-434c-bbcb-2df9f19d8394', 'f7f92ce5-e130-4c87-8b7f-030dcede42e1', '04be1f4f-5e0f-45b3-83b0-7115d776b715'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-da3582d2-2228-4290-a080-79660b33e51a tempest-ProjectMemberTests-391203219 None] Lock "cinder-50faba10-e014-4e60-abbc-b880525e4ffd-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Lock "cinder-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b55d2f-a028-4b9c-9075-2a0840b81f10]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:07 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef Sep 25 11:56:07 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:08 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" returned: 0 in 0.480s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:08 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef Sep 25 11:56:08 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:08 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" returned: 0 in 0.300s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef" released by "delete_volume" :: held 0.866s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Created reservations ['1ecf5421-2349-468e-b7a7-3f69860fd896', '359e6564-da70-449d-a2e0-0a6d37b216b7', '20a4450f-7944-4d79-b495-b7dc091bc536', '13f864f5-fa45-4d60-93a1-7a86200c875a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:08 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:56:08 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:09 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.312s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:09 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-235e62e7-8927-4032-bd5b-2be74ae93a84 tempest-ProjectMemberTests-391203219 None] Lock "cinder-422e5c90-4e10-4a3b-86ae-03a56d1cc2ef-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (da0424c2-322d-43e2-8255-533a83a75763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8135fc57-9987-4944-9ae6-f0e6eaa99bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8135fc57-9987-4944-9ae6-f0e6eaa99bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524811957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffdfd68-591a-46c7-b4f0-fa904212b06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:09Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4178372-b251-4cfa-bcf5-40f1d7540871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4178372-b251-4cfa-bcf5-40f1d7540871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1376da-7ac2-43c3-9b37-a1eb95fb0dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1376da-7ac2-43c3-9b37-a1eb95fb0dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffdfd68-591a-46c7-b4f0-fa904212b06d', 'volume_name': 'volume-cffdfd68-591a-46c7-b4f0-fa904212b06d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b768f985-62fd-44c4-99a2-a16862d282a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b768f985-62fd-44c4-99a2-a16862d282a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47d7c80-7da9-47a8-baf5-0bea9abc99dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Volume cffdfd68-591a-46c7-b4f0-fa904212b06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffdfd68-591a-46c7-b4f0-fa904212b06d', 'volume_size': 1} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524811957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffdfd68-591a-46c7-b4f0-fa904212b06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:09Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Creating volume cffdfd68-591a-46c7-b4f0-fa904212b06d {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:09 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:56:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:09 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d 1073741824 Sep 25 11:56:09 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:10 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d 1073741824" returned: 0 in 0.540s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:10 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d Sep 25 11:56:10 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:10 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d" returned: 0 in 0.316s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47d7c80-7da9-47a8-baf5-0bea9abc99dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffdfd68-591a-46c7-b4f0-fa904212b06d', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a67034c-211e-4d7d-8963-6b41cee330c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:10 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Volume volume-cffdfd68-591a-46c7-b4f0-fa904212b06d (cffdfd68-591a-46c7-b4f0-fa904212b06d): created successfully Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a67034c-211e-4d7d-8963-6b41cee330c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (da0424c2-322d-43e2-8255-533a83a75763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-6c848766-7491-44b0-aaed-e22ac00aa203 tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:56:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Creating offline snapshot 5049d8aa-483d-4029-83dc-d086f033408e of volume cffdfd68-591a-46c7-b4f0-fa904212b06d {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:56:11 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66169aa-c3c6-47f3-99e2-d4ac56ece3a3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:11 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d Sep 25 11:56:11 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:12 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d" returned: 0 in 0.409s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:12 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e 1G Sep 25 11:56:12 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:12 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e 1G" returned: 0 in 0.405s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffdfd68-591a-46c7-b4f0-fa904212b06d -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:12 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffdfd68-591a-46c7-b4f0-fa904212b06d -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e Sep 25 11:56:12 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:12 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffdfd68-591a-46c7-b4f0-fa904212b06d -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e" returned: 0 in 0.284s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:12 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e is being set with open permissions: ugo+rw Sep 25 11:56:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:12 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e Sep 25 11:56:12 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:13 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e" returned: 0 in 0.253s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:13 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.info Sep 25 11:56:13 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:13 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.info" returned: 0 in 0.270s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:13 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.info is being set with open permissions: ugo+rw Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:13 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.info Sep 25 11:56:13 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:13 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.info" returned: 0 in 0.242s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:13 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-e78be08c-7c27-4260-bcf4-7bd858c6409d tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-5049d8aa-483d-4029-83dc-d086f033408e-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Lock "cinder-5049d8aa-483d-4029-83dc-d086f033408e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-cffdfd68-591a-46c7-b4f0-fa904212b06d" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-cffdfd68-591a-46c7-b4f0-fa904212b06d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-5049d8aa-483d-4029-83dc-d086f033408e" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:13 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-5049d8aa-483d-4029-83dc-d086f033408e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot 5049d8aa-483d-4029-83dc-d086f033408e of volume cffdfd68-591a-46c7-b4f0-fa904212b06d {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[34045eca-7c19-4a62-b342-55ad65046a31]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:14 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e Sep 25 11:56:14 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:14 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e" returned: 0 in 0.412s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffdfd68-591a-46c7-b4f0-fa904212b06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf342cc-d397-4c53-958d-0f8bef5e9b5e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:14 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d Sep 25 11:56:14 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:14 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d" returned: 0 in 0.420s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:14 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e Sep 25 11:56:14 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:15 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e" returned: 0 in 0.385s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:15 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e Sep 25 11:56:15 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:15 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d.5049d8aa-483d-4029-83dc-d086f033408e" returned: 0 in 0.275s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-5049d8aa-483d-4029-83dc-d086f033408e" released by "_delete_snapshot" :: held 1.607s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-cffdfd68-591a-46c7-b4f0-fa904212b06d" released by "delete_snapshot" :: held 1.631s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:15 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Created reservations ['d7a45bdb-31e8-42f0-bfc7-ba51a43de761', 'c350a664-2b08-4492-822d-74fef9fdc0cf', '48a3f8ad-6d22-4b41-86f9-8f45cdbf0405', '0faa0bff-b566-4781-b298-d48a798f6cd5'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:15 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:56:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-8a74efe4-b69f-4a7d-a8d4-8fe1ff088b7e tempest-ProjectMemberTests-391203219 None] Lock "cinder-5049d8aa-483d-4029-83dc-d086f033408e-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-cffdfd68-591a-46c7-b4f0-fa904212b06d-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Lock "cinder-cffdfd68-591a-46c7-b4f0-fa904212b06d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-cffdfd68-591a-46c7-b4f0-fa904212b06d" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-cffdfd68-591a-46c7-b4f0-fa904212b06d" acquired by "delete_volume" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[645015bd-769b-4109-9245-44020c0b831e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:16 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d Sep 25 11:56:16 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:16 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d" returned: 0 in 0.439s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:16 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d Sep 25 11:56:16 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:16 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-cffdfd68-591a-46c7-b4f0-fa904212b06d" returned: 0 in 0.271s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-cffdfd68-591a-46c7-b4f0-fa904212b06d" released by "delete_volume" :: held 0.792s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Created reservations ['4811264a-4f86-47f8-b24a-be1f99b6caf4', '13043026-1413-4e49-beb4-d46293827777', '44f52b57-4767-4dc5-8e66-a4a828bca758', '0fa3e039-75ec-4ce9-aedd-1293290a2a05'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:17 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:56:17 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:17 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.352s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-2dc6edcf-b85c-4437-b1f3-4beee7ff760c tempest-ProjectMemberTests-391203219 None] Lock "cinder-cffdfd68-591a-46c7-b4f0-fa904212b06d-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (81300da8-bac4-45cd-94ae-19de7f9f9e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093dac7f-35f8-40d9-aa2f-3b8da258e397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093dac7f-35f8-40d9-aa2f-3b8da258e397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96297911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620b32bf-c072-42c1-ae7c-3cb64bcdd492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:18Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3cae30-7729-4c1a-8d15-466e3d596855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3cae30-7729-4c1a-8d15-466e3d596855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3e2faf-1f73-40e2-8b06-20ae70167031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3e2faf-1f73-40e2-8b06-20ae70167031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620b32bf-c072-42c1-ae7c-3cb64bcdd492', 'volume_name': 'volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7276e03a-a564-4eb7-8cc7-49f98902b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7276e03a-a564-4eb7-8cc7-49f98902b766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82355706-4ed4-4cce-b407-63d7faf66e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:17 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Volume 620b32bf-c072-42c1-ae7c-3cb64bcdd492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492', 'volume_size': 1} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96297911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620b32bf-c072-42c1-ae7c-3cb64bcdd492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:18Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Creating volume 620b32bf-c072-42c1-ae7c-3cb64bcdd492 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:17 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:56:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:18 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 1073741824 Sep 25 11:56:18 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:18 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 1073741824" returned: 0 in 0.525s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:18 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 Sep 25 11:56:18 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:18 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492" returned: 0 in 0.315s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82355706-4ed4-4cce-b407-63d7faf66e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad2b60f-6689-48db-90ba-3974058c2d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:18 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Volume volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 (620b32bf-c072-42c1-ae7c-3cb64bcdd492): created successfully Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad2b60f-6689-48db-90ba-3974058c2d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:18 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (81300da8-bac4-45cd-94ae-19de7f9f9e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:18 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-918b1ee3-14ff-43a8-a557-9c51c08b5e65 tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:56:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Creating offline snapshot 3b17b829-e8b1-4df7-becc-b1f4c09f96cc of volume 620b32bf-c072-42c1-ae7c-3cb64bcdd492 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:56:20 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebd5b62-1d0a-41a5-afac-3bd809829299]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:20 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 Sep 25 11:56:20 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:20 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492" returned: 0 in 0.427s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:20 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc 1G Sep 25 11:56:20 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:21 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc 1G" returned: 0 in 0.474s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:21 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc Sep 25 11:56:21 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:21 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc" returned: 0 in 0.315s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:21 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc is being set with open permissions: ugo+rw Sep 25 11:56:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:21 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc Sep 25 11:56:21 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:21 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc" returned: 0 in 0.260s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:21 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.info Sep 25 11:56:21 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:22 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.info" returned: 0 in 0.308s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:22 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.info is being set with open permissions: ugo+rw Sep 25 11:56:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:22 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.info Sep 25 11:56:22 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:22 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.info" returned: 0 in 0.342s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:22 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-4d4fc073-8dd8-4c28-a103-f0352208e1bd tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:23 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:56:23 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-3b17b829-e8b1-4df7-becc-b1f4c09f96cc-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Lock "cinder-3b17b829-e8b1-4df7-becc-b1f4c09f96cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-620b32bf-c072-42c1-ae7c-3cb64bcdd492" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-620b32bf-c072-42c1-ae7c-3cb64bcdd492" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-3b17b829-e8b1-4df7-becc-b1f4c09f96cc" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-3b17b829-e8b1-4df7-becc-b1f4c09f96cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot 3b17b829-e8b1-4df7-becc-b1f4c09f96cc of volume 620b32bf-c072-42c1-ae7c-3cb64bcdd492 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d1754e-023c-492a-82d6-9bca399835fa]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:23 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc Sep 25 11:56:23 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:23 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.335s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:56:23 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc" returned: 0 in 0.464s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:56:24 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c01efeb-d38d-406c-aaeb-11876a7490b4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:24 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 Sep 25 11:56:24 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:24 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492" returned: 0 in 0.404s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:24 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc Sep 25 11:56:24 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:24 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc" returned: 0 in 0.396s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:24 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc Sep 25 11:56:24 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:25 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492.3b17b829-e8b1-4df7-becc-b1f4c09f96cc" returned: 0 in 0.309s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-3b17b829-e8b1-4df7-becc-b1f4c09f96cc" released by "_delete_snapshot" :: held 1.686s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-620b32bf-c072-42c1-ae7c-3cb64bcdd492" released by "delete_snapshot" :: held 1.717s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Created reservations ['c906d621-1515-47f5-9062-19bc0d94f0dd', '784f39bb-34b6-4be1-b332-2c518c595256', '1db3971b-7f61-4f73-8153-52874b61bd33', '55bd9a41-284b-4389-a57e-2091ee43ec4c'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:25 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c6a9f08b-8993-414c-985c-59606da38096 tempest-ProjectMemberTests-391203219 None] Lock "cinder-3b17b829-e8b1-4df7-becc-b1f4c09f96cc-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-620b32bf-c072-42c1-ae7c-3cb64bcdd492-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Lock "cinder-620b32bf-c072-42c1-ae7c-3cb64bcdd492-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-620b32bf-c072-42c1-ae7c-3cb64bcdd492" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-620b32bf-c072-42c1-ae7c-3cb64bcdd492" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe7a52e-4590-4d8e-8888-95aa616a3782]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:25 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 Sep 25 11:56:25 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:26 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492" returned: 0 in 0.395s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:26 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492 Sep 25 11:56:26 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:26 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-620b32bf-c072-42c1-ae7c-3cb64bcdd492" returned: 0 in 0.291s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-620b32bf-c072-42c1-ae7c-3cb64bcdd492" released by "delete_volume" :: held 0.758s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Created reservations ['2a464319-a15d-4677-922d-d0e60b4c6316', '46f026c0-4048-449f-9449-9168b3021df1', 'c3a8c843-bc85-48af-89c4-83f5cbc6c24e', 'f7c06076-5aa1-4c7a-81c5-c38cb1a78872'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:26 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:56:26 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:26 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.281s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:56:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-bb22e568-368c-44eb-964a-4fba19776c0f tempest-ProjectMemberTests-391203219 None] Lock "cinder-620b32bf-c072-42c1-ae7c-3cb64bcdd492-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (f5b70110-a601-40c6-b3b8-377c59825dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a084799-b616-4abd-bae5-a8bb73cb5623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a084799-b616-4abd-bae5-a8bb73cb5623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1515591325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34ba931-7d9b-48de-93db-d96056893af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:27Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6fa15e-c6a1-4ebb-808a-01abb47f88ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6fa15e-c6a1-4ebb-808a-01abb47f88ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece47957-0951-41da-960d-c0e6978a981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece47957-0951-41da-960d-c0e6978a981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34ba931-7d9b-48de-93db-d96056893af4', 'volume_name': 'volume-a34ba931-7d9b-48de-93db-d96056893af4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd14644-d913-49cc-8cef-02e210a96e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd14644-d913-49cc-8cef-02e210a96e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a1956f-7bac-4b87-aa27-9950dc6261ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:27 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Volume a34ba931-7d9b-48de-93db-d96056893af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34ba931-7d9b-48de-93db-d96056893af4', 'volume_size': 1} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1515591325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34ba931-7d9b-48de-93db-d96056893af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:27Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Creating volume a34ba931-7d9b-48de-93db-d96056893af4 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:27 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:56:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:27 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 1073741824 Sep 25 11:56:27 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:28 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 1073741824" returned: 0 in 0.530s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:28 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 Sep 25 11:56:28 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:28 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4" returned: 0 in 0.294s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a1956f-7bac-4b87-aa27-9950dc6261ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34ba931-7d9b-48de-93db-d96056893af4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8427d5b4-9ec2-4f22-b76a-b4a07a2740c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:28 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Volume volume-a34ba931-7d9b-48de-93db-d96056893af4 (a34ba931-7d9b-48de-93db-d96056893af4): created successfully Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8427d5b4-9ec2-4f22-b76a-b4a07a2740c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (f5b70110-a601-40c6-b3b8-377c59825dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:28 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-2717432b-2617-48f4-9b76-3e01a09f2fc5 tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:56:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Creating offline snapshot c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d of volume a34ba931-7d9b-48de-93db-d96056893af4 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:56:29 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc0c044-c5c3-4801-a8ae-1d8ec1886457]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:29 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 Sep 25 11:56:29 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:30 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4" returned: 0 in 0.437s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:30 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d 1G Sep 25 11:56:30 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:30 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d 1G" returned: 0 in 0.551s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34ba931-7d9b-48de-93db-d96056893af4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:30 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34ba931-7d9b-48de-93db-d96056893af4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d Sep 25 11:56:30 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:31 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34ba931-7d9b-48de-93db-d96056893af4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d" returned: 0 in 0.325s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:31 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d is being set with open permissions: ugo+rw Sep 25 11:56:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:31 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d Sep 25 11:56:31 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:31 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d" returned: 0 in 0.251s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:31 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.info Sep 25 11:56:31 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:31 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.info" returned: 0 in 0.277s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:31 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.info is being set with open permissions: ugo+rw Sep 25 11:56:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:31 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.info Sep 25 11:56:31 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:31 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.info" returned: 0 in 0.252s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-fee4ea3c-8ac7-4420-80eb-40ca300dcbaf tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Lock "cinder-c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-a34ba931-7d9b-48de-93db-d96056893af4" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-a34ba931-7d9b-48de-93db-d96056893af4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d of volume a34ba931-7d9b-48de-93db-d96056893af4 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9554d37c-a6e6-4069-933d-aa3f05f252f7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:33 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d Sep 25 11:56:33 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:33 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d" returned: 0 in 0.438s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34ba931-7d9b-48de-93db-d96056893af4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:56:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f3e6e7-bea3-4c4b-ba06-ecf31ff9f636]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:33 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 Sep 25 11:56:33 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:33 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4" returned: 0 in 0.383s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:33 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d Sep 25 11:56:33 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:34 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d" returned: 0 in 0.390s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:34 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d Sep 25 11:56:34 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:34 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4.c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d" returned: 0 in 0.290s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d" released by "_delete_snapshot" :: held 1.611s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-a34ba931-7d9b-48de-93db-d96056893af4" released by "delete_snapshot" :: held 1.639s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:34 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Created reservations ['b6d6adb8-e9ac-43c9-badd-2a6dd5f6b5c5', '2c417a95-69e9-45e4-9ade-a7a914340ff0', '6ca2f25a-460b-473d-a071-701ae6692ec9', 'cb68fd53-7bae-4bd0-8316-cd75ec3b04e0'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:56:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-50729114-2f4e-455e-8feb-98989c9f4180 tempest-ProjectMemberTests-391203219 None] Lock "cinder-c42ae9b8-bd91-47ae-a5dd-e4e4c4cdcc6d-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-a34ba931-7d9b-48de-93db-d96056893af4-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Lock "cinder-a34ba931-7d9b-48de-93db-d96056893af4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-a34ba931-7d9b-48de-93db-d96056893af4" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-a34ba931-7d9b-48de-93db-d96056893af4" acquired by "delete_volume" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d526a-387a-464c-8d77-50d76e215bd1]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:35 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 Sep 25 11:56:35 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:35 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4" returned: 0 in 0.445s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:35 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4 Sep 25 11:56:35 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:35 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-a34ba931-7d9b-48de-93db-d96056893af4" returned: 0 in 0.256s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-a34ba931-7d9b-48de-93db-d96056893af4" released by "delete_volume" :: held 0.780s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Created reservations ['006a3085-8893-41c1-a9ab-7eb6bbe42f18', '6404cf7b-cdd5-4035-a515-20b03692af50', 'f6476715-ea88-4541-adc2-eb6492825317', 'd5678ec2-bf26-4e52-97a1-36b7485b79b1'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:36 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:56:36 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:36 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.289s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ac493672-d507-4bf6-865e-cd5a817c2765 tempest-ProjectMemberTests-391203219 None] Lock "cinder-a34ba931-7d9b-48de-93db-d96056893af4-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (49a867d0-e095-4b99-992f-f5789e7e5c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53999688-05df-425b-acd1-d3e61bfd94e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53999688-05df-425b-acd1-d3e61bfd94e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780094622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63398a6b-4993-403f-b019-24e2e00913d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:37Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6bec81-3422-4980-bbb0-a7e1581d7eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6bec81-3422-4980-bbb0-a7e1581d7eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4147399-26f3-4f0f-8d85-f66c5f71d6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4147399-26f3-4f0f-8d85-f66c5f71d6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63398a6b-4993-403f-b019-24e2e00913d8', 'volume_name': 'volume-63398a6b-4993-403f-b019-24e2e00913d8', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b265b70e-df32-4950-9e19-02f2ee2b80d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b265b70e-df32-4950-9e19-02f2ee2b80d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1770418-47a0-4d61-acab-f9e78369cbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:36 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Volume 63398a6b-4993-403f-b019-24e2e00913d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63398a6b-4993-403f-b019-24e2e00913d8', 'volume_size': 1} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780094622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63398a6b-4993-403f-b019-24e2e00913d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b52b260c8e4c87a13decd1adde4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:37Z,use_quota=True,user_id='1de35fa9fd81428fae72fc303fbfc605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Creating volume 63398a6b-4993-403f-b019-24e2e00913d8 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:36 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:56:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:36 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 1073741824 Sep 25 11:56:36 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:37 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 1073741824" returned: 0 in 0.500s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:37 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 Sep 25 11:56:37 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:37 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8" returned: 0 in 0.262s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1770418-47a0-4d61-acab-f9e78369cbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63398a6b-4993-403f-b019-24e2e00913d8', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdaa8c4-9124-440e-9598-d82be176179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:37 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Volume volume-63398a6b-4993-403f-b019-24e2e00913d8 (63398a6b-4993-403f-b019-24e2e00913d8): created successfully Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdaa8c4-9124-440e-9598-d82be176179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:37 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Flow 'volume_create_manager' (49a867d0-e095-4b99-992f-f5789e7e5c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:37 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-83086667-b939-438b-8c42-671c8bfc80c4 tempest-ProjectMemberTests-391203219 None] Created volume successfully. Sep 25 11:56:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:39 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Creating offline snapshot 3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 of volume 63398a6b-4993-403f-b019-24e2e00913d8 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:56:39 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d6977-ecf6-48b0-b704-61f3bede0cab]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:39 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 Sep 25 11:56:39 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:39 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8" returned: 0 in 0.417s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:39 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:39 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 1G Sep 25 11:56:39 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:40 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 1G" returned: 0 in 0.463s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63398a6b-4993-403f-b019-24e2e00913d8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:40 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63398a6b-4993-403f-b019-24e2e00913d8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 Sep 25 11:56:40 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:40 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63398a6b-4993-403f-b019-24e2e00913d8 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4" returned: 0 in 0.311s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:40 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 is being set with open permissions: ugo+rw Sep 25 11:56:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:40 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 Sep 25 11:56:40 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:40 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4" returned: 0 in 0.241s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:40 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.info Sep 25 11:56:40 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:40 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.info" returned: 0 in 0.275s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:40 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.info is being set with open permissions: ugo+rw Sep 25 11:56:40 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:40 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.info Sep 25 11:56:40 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:41 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.info" returned: 0 in 0.269s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:41 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:41 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-242059f7-6154-4da2-812c-6054c47ae5f5 tempest-ProjectMemberTests-391203219 None] Create snapshot completed successfully Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-3a4db5ee-f067-4e4d-8c86-9e01f4282ef4-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Lock "cinder-3a4db5ee-f067-4e4d-8c86-9e01f4282ef4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-63398a6b-4993-403f-b019-24e2e00913d8" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-63398a6b-4993-403f-b019-24e2e00913d8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-3a4db5ee-f067-4e4d-8c86-9e01f4282ef4" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-3a4db5ee-f067-4e4d-8c86-9e01f4282ef4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Deleting offline snapshot 3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 of volume 63398a6b-4993-403f-b019-24e2e00913d8 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] snapshot_file for this snap is: volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa177bf9-a5f8-4314-96d1-ad725a7a33d7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:42 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 Sep 25 11:56:42 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:42 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4" returned: 0 in 0.431s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:42 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63398a6b-4993-403f-b019-24e2e00913d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:56:43 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7652224c-93b9-43bb-844e-08b6b64653a6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:43 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 Sep 25 11:56:43 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:43 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8" returned: 0 in 0.401s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:43 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 Sep 25 11:56:43 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:43 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4" returned: 0 in 0.353s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:43 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:43 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4 Sep 25 11:56:43 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:44 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8.3a4db5ee-f067-4e4d-8c86-9e01f4282ef4" returned: 0 in 0.287s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-3a4db5ee-f067-4e4d-8c86-9e01f4282ef4" released by "_delete_snapshot" :: held 1.580s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-63398a6b-4993-403f-b019-24e2e00913d8" released by "delete_snapshot" :: held 1.603s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Created reservations ['9e5887ba-2a67-4972-b27c-772e17158a6d', '23719eac-16fe-426e-94b3-4ee202257fa6', '4743bad2-fbfe-4a22-a726-3454256960b6', '2c2c459a-f1c9-4e01-a6f1-f737abf89803'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:44 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Delete snapshot completed successfully. Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ae988834-aa86-490e-9966-c50ba4e72979 tempest-ProjectMemberTests-391203219 None] Lock "cinder-3a4db5ee-f067-4e4d-8c86-9e01f4282ef4-delete_snapshot" released by "delete_snapshot" :: held 1.763s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-63398a6b-4993-403f-b019-24e2e00913d8-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Lock "cinder-63398a6b-4993-403f-b019-24e2e00913d8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=102,cinder:INSERT=42,cinder:UPDATE=124,cinder:DELETE=16 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=106,cinder:INSERT=35,cinder:UPDATE=152,cinder:DELETE=6 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Acquiring lock "cinder-quobyte-63398a6b-4993-403f-b019-24e2e00913d8" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-63398a6b-4993-403f-b019-24e2e00913d8" acquired by "delete_volume" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1362e8-1b85-4bf3-809f-125e60cc4433]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:44 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:44 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 Sep 25 11:56:44 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:45 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8" returned: 0 in 0.446s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:45 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8 Sep 25 11:56:45 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:45 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-63398a6b-4993-403f-b019-24e2e00913d8" returned: 0 in 0.284s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Lock "cinder-quobyte-63398a6b-4993-403f-b019-24e2e00913d8" released by "delete_volume" :: held 0.811s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Created reservations ['cc2ce296-474a-48ea-9ae5-df98de9efe10', 'ef470e4e-ddcf-4e47-b82b-9dd94292596b', '73fff3f1-9bbc-425b-8b1c-bed4a81e7ec0', 'd7dc2444-a01c-45be-af73-0d37c317dd13'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:45 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:56:45 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:45 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.299s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:45 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:45 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Deleted volume successfully. Sep 25 11:56:46 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-7725ef61-f19e-4a7c-806f-bcb7e6f7a90c tempest-ProjectMemberTests-391203219 None] Lock "cinder-63398a6b-4993-403f-b019-24e2e00913d8-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (73549d65-c8c6-45b2-95e7-869d8e7fd51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af41f20-79f5-4ecb-9911-4e48c35427f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af41f20-79f5-4ecb-9911-4e48c35427f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199236740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bcd461-844a-4356-ba32-cc48511fcdc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:51Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bbed02-c0af-438a-9479-e3405d665741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bbed02-c0af-438a-9479-e3405d665741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af5787e-fc1f-48b4-85b9-1a34d1854063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af5787e-fc1f-48b4-85b9-1a34d1854063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39bcd461-844a-4356-ba32-cc48511fcdc4', 'volume_name': 'volume-39bcd461-844a-4356-ba32-cc48511fcdc4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2674d4f-61d6-4d74-8aeb-d4176acb2c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2674d4f-61d6-4d74-8aeb-d4176acb2c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6a128c-9954-4d42-a9bd-a17a3fafbd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:50 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Volume 39bcd461-844a-4356-ba32-cc48511fcdc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39bcd461-844a-4356-ba32-cc48511fcdc4', 'volume_size': 1} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199236740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bcd461-844a-4356-ba32-cc48511fcdc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:51Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Creating volume 39bcd461-844a-4356-ba32-cc48511fcdc4 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:50 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:56:50 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:50 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 1073741824 Sep 25 11:56:50 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:51 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 1073741824" returned: 0 in 0.472s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:51 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 Sep 25 11:56:51 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:51 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4" returned: 0 in 0.272s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6a128c-9954-4d42-a9bd-a17a3fafbd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39bcd461-844a-4356-ba32-cc48511fcdc4', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3272ffb7-b3b3-4169-a946-db202c163881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:51 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Volume volume-39bcd461-844a-4356-ba32-cc48511fcdc4 (39bcd461-844a-4356-ba32-cc48511fcdc4): created successfully Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3272ffb7-b3b3-4169-a946-db202c163881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:51 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (73549d65-c8c6-45b2-95e7-869d8e7fd51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:51 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-514c6f94-c3fa-412a-80ca-8bcb3e4a33b7 tempest-ProjectReaderTests-1063681058 None] Created volume successfully. Sep 25 11:56:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:52 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Creating offline snapshot 11f396db-ddbb-4c41-a6f3-0e163d62bc27 of volume 39bcd461-844a-4356-ba32-cc48511fcdc4 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:56:52 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62c90df-4665-4228-b32c-370bbf2fbfa3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:52 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:53 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 Sep 25 11:56:53 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:53 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4" returned: 0 in 0.424s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:53 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 1G Sep 25 11:56:53 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:53 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 1G" returned: 0 in 0.479s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:53 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39bcd461-844a-4356-ba32-cc48511fcdc4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:53 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39bcd461-844a-4356-ba32-cc48511fcdc4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 Sep 25 11:56:53 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:54 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39bcd461-844a-4356-ba32-cc48511fcdc4 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27" returned: 0 in 0.347s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:54 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 is being set with open permissions: ugo+rw Sep 25 11:56:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:54 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 Sep 25 11:56:54 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:54 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27" returned: 0 in 0.267s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:54 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.info Sep 25 11:56:54 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:54 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.info" returned: 0 in 0.295s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:54 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.info is being set with open permissions: ugo+rw Sep 25 11:56:54 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:54 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.info Sep 25 11:56:54 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:55 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.info" returned: 0 in 0.302s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:55 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:55 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-bf57984d-1e89-44b6-b795-4437c7486c67 tempest-ProjectReaderTests-1063681058 None] Create snapshot completed successfully Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-11f396db-ddbb-4c41-a6f3-0e163d62bc27-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Lock "cinder-11f396db-ddbb-4c41-a6f3-0e163d62bc27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-39bcd461-844a-4356-ba32-cc48511fcdc4" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-39bcd461-844a-4356-ba32-cc48511fcdc4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-11f396db-ddbb-4c41-a6f3-0e163d62bc27" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-11f396db-ddbb-4c41-a6f3-0e163d62bc27" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Deleting offline snapshot 11f396db-ddbb-4c41-a6f3-0e163d62bc27 of volume 39bcd461-844a-4356-ba32-cc48511fcdc4 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] snapshot_file for this snap is: volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3736862-db9b-4536-bc5e-833b68fb4318]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:56 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 Sep 25 11:56:56 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:56 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27" returned: 0 in 0.415s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39bcd461-844a-4356-ba32-cc48511fcdc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f5b911-5d3d-4d2e-a033-41144376cdc0]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:56 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:57 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 Sep 25 11:56:57 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:57 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4" returned: 0 in 0.396s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:57 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 Sep 25 11:56:57 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:57 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27" returned: 0 in 0.403s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:57 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:57 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27 Sep 25 11:56:57 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:58 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4.11f396db-ddbb-4c41-a6f3-0e163d62bc27" returned: 0 in 0.291s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-11f396db-ddbb-4c41-a6f3-0e163d62bc27" released by "_delete_snapshot" :: held 1.626s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-39bcd461-844a-4356-ba32-cc48511fcdc4" released by "delete_snapshot" :: held 1.652s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Created reservations ['1bc0a1dc-35f2-4a4f-9d9e-f0c59af75f1b', '5d4e0520-e71e-4bd6-8429-5be4979227b1', '5cb73dbd-2d26-48ac-b264-244c55a7d0dd', '4f5634e5-8459-4022-b109-097fb6b66b02'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:58 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Delete snapshot completed successfully. Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ad9efadd-e211-45e1-8cf2-da37cc7c7c6d tempest-ProjectReaderTests-1063681058 None] Lock "cinder-11f396db-ddbb-4c41-a6f3-0e163d62bc27-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-39bcd461-844a-4356-ba32-cc48511fcdc4-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-39bcd461-844a-4356-ba32-cc48511fcdc4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-39bcd461-844a-4356-ba32-cc48511fcdc4" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-39bcd461-844a-4356-ba32-cc48511fcdc4" acquired by "delete_volume" :: waited 0.018s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[02133c28-7418-4993-9265-1345b8099fa6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:58 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:58 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 Sep 25 11:56:58 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:59 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4" returned: 0 in 0.392s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:59 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4 Sep 25 11:56:59 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:59 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-39bcd461-844a-4356-ba32-cc48511fcdc4" returned: 0 in 0.305s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-39bcd461-844a-4356-ba32-cc48511fcdc4" released by "delete_volume" :: held 0.768s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Created reservations ['75199f76-6306-4c71-9346-6ed9169ea8dd', 'a084624f-34f1-454d-8636-fbdbcdfe9c44', 'd299953b-15a9-40aa-a497-6ede1312f916', '8ff5820e-ec41-4f5a-8257-07ebcb012c6a'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:59 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:56:59 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:59 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.299s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:59 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Deleted volume successfully. Sep 25 11:56:59 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-97ba4d40-ece5-4f79-82b4-c54c9e7e2aa9 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-39bcd461-844a-4356-ba32-cc48511fcdc4-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (ded255f9-ff97-4a55-a3ce-a671290a5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118ad2e3-4ea0-493a-ba5f-259b62bfed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118ad2e3-4ea0-493a-ba5f-259b62bfed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573204320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb02d517-ceb7-40ac-9c60-1ada5e721369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:00Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3bb297-440f-4a15-af6d-4ab3801e7f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3bb297-440f-4a15-af6d-4ab3801e7f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65233c8-e2f2-43fe-8580-c0337830f181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65233c8-e2f2-43fe-8580-c0337830f181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb02d517-ceb7-40ac-9c60-1ada5e721369', 'volume_name': 'volume-eb02d517-ceb7-40ac-9c60-1ada5e721369', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85e9de2-24c5-409c-a7d2-e69fa67cf47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85e9de2-24c5-409c-a7d2-e69fa67cf47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d0ef14-006d-4cfb-9f94-3834723d49ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:00 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Volume eb02d517-ceb7-40ac-9c60-1ada5e721369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb02d517-ceb7-40ac-9c60-1ada5e721369', 'volume_size': 1} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573204320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb02d517-ceb7-40ac-9c60-1ada5e721369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:00Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Creating volume eb02d517-ceb7-40ac-9c60-1ada5e721369 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:57:00 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:00 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 1073741824 Sep 25 11:57:00 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:00 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 1073741824" returned: 0 in 0.451s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:00 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:00 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 Sep 25 11:57:00 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:01 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369" returned: 0 in 0.264s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:01 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:57:01 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d0ef14-006d-4cfb-9f94-3834723d49ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb02d517-ceb7-40ac-9c60-1ada5e721369', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66394ad9-3b0e-464b-b3c9-891ad2a5a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:01 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Volume volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 (eb02d517-ceb7-40ac-9c60-1ada5e721369): created successfully Sep 25 11:57:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66394ad9-3b0e-464b-b3c9-891ad2a5a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:01 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (ded255f9-ff97-4a55-a3ce-a671290a5223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:01 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-80d41562-892d-4553-bdfe-9632bb4769be tempest-ProjectReaderTests-1063681058 None] Created volume successfully. Sep 25 11:57:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:02 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Creating offline snapshot 503f489d-a139-4d0c-8799-bd2f2f3cad5f of volume eb02d517-ceb7-40ac-9c60-1ada5e721369 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:57:02 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db7eea-7cf7-4307-a118-27ea22e7543c]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:02 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 Sep 25 11:57:02 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:02 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369" returned: 0 in 0.396s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:02 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:03 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f 1G Sep 25 11:57:03 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:03 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f 1G" returned: 0 in 0.473s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:03 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f Sep 25 11:57:03 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:03 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f" returned: 0 in 0.327s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:03 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f is being set with open permissions: ugo+rw Sep 25 11:57:03 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:03 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f Sep 25 11:57:03 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:04 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f" returned: 0 in 0.259s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:04 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.info Sep 25 11:57:04 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:04 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.info" returned: 0 in 0.296s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:04 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.info is being set with open permissions: ugo+rw Sep 25 11:57:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:04 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.info Sep 25 11:57:04 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:04 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.info" returned: 0 in 0.294s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:04 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:04 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f14657f8-efbe-4b31-8a31-9b93670d8ec8 tempest-ProjectReaderTests-1063681058 None] Create snapshot completed successfully Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-503f489d-a139-4d0c-8799-bd2f2f3cad5f-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-503f489d-a139-4d0c-8799-bd2f2f3cad5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-eb02d517-ceb7-40ac-9c60-1ada5e721369" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-eb02d517-ceb7-40ac-9c60-1ada5e721369" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-503f489d-a139-4d0c-8799-bd2f2f3cad5f" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-503f489d-a139-4d0c-8799-bd2f2f3cad5f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Deleting offline snapshot 503f489d-a139-4d0c-8799-bd2f2f3cad5f of volume eb02d517-ceb7-40ac-9c60-1ada5e721369 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] snapshot_file for this snap is: volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe6499d-614e-47fc-9580-e6a55b6f33c5]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:05 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:05 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f Sep 25 11:57:05 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:06 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f" returned: 0 in 0.407s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:06 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb02d517-ceb7-40ac-9c60-1ada5e721369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:57:06 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e679a4-d2a8-45bf-a250-26b296a232e4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:06 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 Sep 25 11:57:06 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:06 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369" returned: 0 in 0.436s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:06 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:06 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f Sep 25 11:57:06 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:07 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f" returned: 0 in 0.419s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:07 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f Sep 25 11:57:07 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:07 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369.503f489d-a139-4d0c-8799-bd2f2f3cad5f" returned: 0 in 0.324s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-503f489d-a139-4d0c-8799-bd2f2f3cad5f" released by "_delete_snapshot" :: held 1.712s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-eb02d517-ceb7-40ac-9c60-1ada5e721369" released by "delete_snapshot" :: held 1.741s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Created reservations ['4fbbe8f0-7384-41de-9d46-3d7c5df22027', 'fea91c7a-0ef6-4345-9a4e-39c39ca56a72', '63d670d8-ecf1-400d-9a76-3b1619dc3f04', 'd18ae12f-9301-46a8-945f-1fcce9e69b70'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:07 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Delete snapshot completed successfully. Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-ff22cb55-5cae-4904-a032-001f9866f628 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-503f489d-a139-4d0c-8799-bd2f2f3cad5f-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-eb02d517-ceb7-40ac-9c60-1ada5e721369-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:07 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-eb02d517-ceb7-40ac-9c60-1ada5e721369-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-eb02d517-ceb7-40ac-9c60-1ada5e721369" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-eb02d517-ceb7-40ac-9c60-1ada5e721369" acquired by "delete_volume" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e084355-b202-4410-9575-7b5b25b2df6e]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:08 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 Sep 25 11:57:08 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:08 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369" returned: 0 in 0.424s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:08 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369 Sep 25 11:57:08 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:08 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-eb02d517-ceb7-40ac-9c60-1ada5e721369" returned: 0 in 0.298s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-eb02d517-ceb7-40ac-9c60-1ada5e721369" released by "delete_volume" :: held 0.798s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Created reservations ['e77855c2-0a6d-4103-b03d-c43635670789', '56378e22-4fa9-44e0-88d7-4d70064a8f7d', 'b0820677-e595-443f-ba5d-501b80f65833', '5926c60c-2425-49dc-8ece-5edc0af48c83'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:08 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:09 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:57:09 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:09 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.312s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:09 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Deleted volume successfully. Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-05393c8c-1c9a-45cb-9d8e-fa98cc167b56 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-eb02d517-ceb7-40ac-9c60-1ada5e721369-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (9bac3103-23e5-4bca-ad04-b7a75dcd1982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca33c86-fc2f-42b9-bb64-3acc5502b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca33c86-fc2f-42b9-bb64-3acc5502b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364939761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde43b40-c84d-458c-9c52-119b226338f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:10Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81427d74-6a60-48e8-954a-5c5309a5172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81427d74-6a60-48e8-954a-5c5309a5172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2c64c0-628b-4e8d-ae10-0795f447a6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2c64c0-628b-4e8d-ae10-0795f447a6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde43b40-c84d-458c-9c52-119b226338f9', 'volume_name': 'volume-dde43b40-c84d-458c-9c52-119b226338f9', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd65edc8-2649-4420-9909-76b166f079f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd65edc8-2649-4420-9909-76b166f079f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f234f3-029f-4dbd-aa0d-77f7c94adaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:09 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Volume dde43b40-c84d-458c-9c52-119b226338f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde43b40-c84d-458c-9c52-119b226338f9', 'volume_size': 1} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364939761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde43b40-c84d-458c-9c52-119b226338f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:10Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Creating volume dde43b40-c84d-458c-9c52-119b226338f9 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:57:09 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:57:09 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:09 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 1073741824 Sep 25 11:57:09 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:10 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 1073741824" returned: 0 in 0.499s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:10 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 Sep 25 11:57:10 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:10 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9" returned: 0 in 0.284s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f234f3-029f-4dbd-aa0d-77f7c94adaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde43b40-c84d-458c-9c52-119b226338f9', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff455101-39d1-4de2-bb8a-18bf46314582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:10 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Volume volume-dde43b40-c84d-458c-9c52-119b226338f9 (dde43b40-c84d-458c-9c52-119b226338f9): created successfully Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff455101-39d1-4de2-bb8a-18bf46314582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:10 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (9bac3103-23e5-4bca-ad04-b7a75dcd1982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:10 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-0a863bef-4351-44c7-a614-9e747ef79796 tempest-ProjectReaderTests-1063681058 None] Created volume successfully. Sep 25 11:57:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:11 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:11 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Creating offline snapshot 17cc9f76-a5b5-40f2-a62e-15c859f4e97f of volume dde43b40-c84d-458c-9c52-119b226338f9 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:57:12 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[574e5326-07a0-4300-8ad4-38a5ba3f8f9b]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:12 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 Sep 25 11:57:12 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:12 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9" returned: 0 in 0.471s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:12 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f 1G Sep 25 11:57:12 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:12 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f 1G" returned: 0 in 0.455s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:12 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde43b40-c84d-458c-9c52-119b226338f9 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:12 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde43b40-c84d-458c-9c52-119b226338f9 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f Sep 25 11:57:12 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:13 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde43b40-c84d-458c-9c52-119b226338f9 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f" returned: 0 in 0.306s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:13 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f is being set with open permissions: ugo+rw Sep 25 11:57:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:13 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f Sep 25 11:57:13 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:13 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f" returned: 0 in 0.277s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:13 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.info Sep 25 11:57:13 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:13 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.info" returned: 0 in 0.265s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:13 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.info is being set with open permissions: ugo+rw Sep 25 11:57:13 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:13 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.info Sep 25 11:57:13 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:14 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.info" returned: 0 in 0.308s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:14 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:14 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-f166ae54-a32f-443f-9827-5ac68d1b9164 tempest-ProjectReaderTests-1063681058 None] Create snapshot completed successfully Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-17cc9f76-a5b5-40f2-a62e-15c859f4e97f-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-17cc9f76-a5b5-40f2-a62e-15c859f4e97f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-dde43b40-c84d-458c-9c52-119b226338f9" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-dde43b40-c84d-458c-9c52-119b226338f9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-17cc9f76-a5b5-40f2-a62e-15c859f4e97f" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-17cc9f76-a5b5-40f2-a62e-15c859f4e97f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Deleting offline snapshot 17cc9f76-a5b5-40f2-a62e-15c859f4e97f of volume dde43b40-c84d-458c-9c52-119b226338f9 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] snapshot_file for this snap is: volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f490dc-ac39-49b5-8e28-d7fd321de3c6]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:15 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f Sep 25 11:57:15 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:15 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f" returned: 0 in 0.447s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde43b40-c84d-458c-9c52-119b226338f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f72ff8-a423-4d72-84c8-1bc01622adad]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:15 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:15 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 Sep 25 11:57:15 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:16 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9" returned: 0 in 0.402s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:16 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f Sep 25 11:57:16 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:16 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f" returned: 0 in 0.376s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:16 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f Sep 25 11:57:16 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:16 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:16 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9.17cc9f76-a5b5-40f2-a62e-15c859f4e97f" returned: 0 in 0.327s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-17cc9f76-a5b5-40f2-a62e-15c859f4e97f" released by "_delete_snapshot" :: held 1.670s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:16 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-dde43b40-c84d-458c-9c52-119b226338f9" released by "delete_snapshot" :: held 1.696s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:16 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Created reservations ['21b6042d-432a-4286-85a9-04a5a630ac86', 'ae6a9276-8cc3-497c-9ad3-810eebb07039', '5a5e4926-2ad9-41c9-b6bf-424cd8eb1ca1', '5aa91ad0-5897-49bf-a1bd-6fc6f95e2ea5'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:17 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Delete snapshot completed successfully. Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-13bed803-1cab-404b-87a7-a0058b246958 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-17cc9f76-a5b5-40f2-a62e-15c859f4e97f-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-dde43b40-c84d-458c-9c52-119b226338f9-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Lock "cinder-dde43b40-c84d-458c-9c52-119b226338f9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-dde43b40-c84d-458c-9c52-119b226338f9" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-dde43b40-c84d-458c-9c52-119b226338f9" acquired by "delete_volume" :: waited 0.022s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ec756-e036-4072-a4e6-89b02b67d0ae]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:17 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 Sep 25 11:57:17 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:17 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9" returned: 0 in 0.412s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:17 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:17 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9 Sep 25 11:57:17 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:18 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-dde43b40-c84d-458c-9c52-119b226338f9" returned: 0 in 0.317s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-dde43b40-c84d-458c-9c52-119b226338f9" released by "delete_volume" :: held 0.809s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Created reservations ['d8d542a2-09b7-4731-9f23-ed41dc437de3', '50b27fbf-e6fa-4112-8019-c3d63ea615c9', 'fe9b9b0a-7c65-486d-a54d-24a78418ead3', '53ef621f-6a18-48ed-b336-8ec5e1064f32'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:18 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:57:18 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:18 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.367s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:18 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Deleted volume successfully. Sep 25 11:57:18 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-84ceea39-911a-4420-af3f-ff644c933f2c tempest-ProjectReaderTests-1063681058 None] Lock "cinder-dde43b40-c84d-458c-9c52-119b226338f9-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (f5bf4a12-fdcf-440a-80f1-49ba834fa543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f57f5ce-4d7b-46e7-a97d-06642525b619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f57f5ce-4d7b-46e7-a97d-06642525b619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121633465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852576da-c9a5-4aa2-8d7e-726180bd1604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:19Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ecc4e4-1dac-4a2b-8eaa-f57b5a475bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ecc4e4-1dac-4a2b-8eaa-f57b5a475bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e4ee4e-294c-4061-9677-94083ed6f6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e4ee4e-294c-4061-9677-94083ed6f6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852576da-c9a5-4aa2-8d7e-726180bd1604', 'volume_name': 'volume-852576da-c9a5-4aa2-8d7e-726180bd1604', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d4ed6e-034e-45f2-afd6-ce8e681bbe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d4ed6e-034e-45f2-afd6-ce8e681bbe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3621b375-eefc-48a7-a4bb-2c3be08039c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:19 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Volume 852576da-c9a5-4aa2-8d7e-726180bd1604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852576da-c9a5-4aa2-8d7e-726180bd1604', 'volume_size': 1} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121633465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852576da-c9a5-4aa2-8d7e-726180bd1604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:19Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Creating volume 852576da-c9a5-4aa2-8d7e-726180bd1604 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:57:19 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:19 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 1073741824 Sep 25 11:57:19 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:19 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 1073741824" returned: 0 in 0.528s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:19 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:19 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 Sep 25 11:57:19 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:20 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604" returned: 0 in 0.283s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:20 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:57:20 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3621b375-eefc-48a7-a4bb-2c3be08039c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852576da-c9a5-4aa2-8d7e-726180bd1604', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03523990-6c28-490a-99be-4cbfdeb1c0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:20 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Volume volume-852576da-c9a5-4aa2-8d7e-726180bd1604 (852576da-c9a5-4aa2-8d7e-726180bd1604): created successfully Sep 25 11:57:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03523990-6c28-490a-99be-4cbfdeb1c0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:20 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (f5bf4a12-fdcf-440a-80f1-49ba834fa543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:20 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c6012529-da52-40e1-a3bf-f6ee700859d2 tempest-ProjectReaderTests-1063681058 None] Created volume successfully. Sep 25 11:57:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:21 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Creating offline snapshot 706d4b6a-2a64-449d-b61f-78a76ba44ada of volume 852576da-c9a5-4aa2-8d7e-726180bd1604 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:57:21 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c1b0f1-1901-442f-9268-99427cc48ec8]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:21 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 Sep 25 11:57:21 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:21 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604" returned: 0 in 0.424s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:21 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:21 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada 1G Sep 25 11:57:21 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:22 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada 1G" returned: 0 in 0.427s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852576da-c9a5-4aa2-8d7e-726180bd1604 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:22 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852576da-c9a5-4aa2-8d7e-726180bd1604 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada Sep 25 11:57:22 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:22 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852576da-c9a5-4aa2-8d7e-726180bd1604 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada" returned: 0 in 0.306s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:22 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada is being set with open permissions: ugo+rw Sep 25 11:57:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:22 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada Sep 25 11:57:22 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:22 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada" returned: 0 in 0.276s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:22 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:22 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.info Sep 25 11:57:22 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:23 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.info" returned: 0 in 0.277s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:23 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.info is being set with open permissions: ugo+rw Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:23 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.info Sep 25 11:57:23 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:23 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:57:23 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:23 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.info" returned: 0 in 0.311s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:23 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-988c9030-11db-4728-a3bf-a1525356bd87 tempest-ProjectReaderTests-1063681058 None] Create snapshot completed successfully Sep 25 11:57:23 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.321s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:57:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-706d4b6a-2a64-449d-b61f-78a76ba44ada-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-706d4b6a-2a64-449d-b61f-78a76ba44ada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-852576da-c9a5-4aa2-8d7e-726180bd1604" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-852576da-c9a5-4aa2-8d7e-726180bd1604" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-706d4b6a-2a64-449d-b61f-78a76ba44ada" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-706d4b6a-2a64-449d-b61f-78a76ba44ada" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Deleting offline snapshot 706d4b6a-2a64-449d-b61f-78a76ba44ada of volume 852576da-c9a5-4aa2-8d7e-726180bd1604 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] snapshot_file for this snap is: volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18dc0ad-00ca-44e6-aac5-c398cd089922]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:24 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:24 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada Sep 25 11:57:24 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:25 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada" returned: 0 in 0.431s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:25 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852576da-c9a5-4aa2-8d7e-726180bd1604(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:57:25 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be4e90-6279-4e0f-ac3c-f4b87c970dc3]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:25 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 Sep 25 11:57:25 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:25 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604" returned: 0 in 0.458s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:25 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada Sep 25 11:57:25 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:25 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada" returned: 0 in 0.374s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:25 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:26 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada Sep 25 11:57:26 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:26 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604.706d4b6a-2a64-449d-b61f-78a76ba44ada" returned: 0 in 0.297s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-706d4b6a-2a64-449d-b61f-78a76ba44ada" released by "_delete_snapshot" :: held 1.696s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-852576da-c9a5-4aa2-8d7e-726180bd1604" released by "delete_snapshot" :: held 1.726s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Created reservations ['c144f337-07fb-4b2f-8f1c-9b6ede3c42c9', 'a2db8475-524a-4510-9f74-f7e2dea50afc', 'e12853a1-b9af-4e36-bf93-b59cac9b9664', 'ad7578de-d929-4484-874d-f1863cff4fe3'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:26 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Delete snapshot completed successfully. Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-64aeff93-df02-401b-a3d6-4b205c39e159 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-706d4b6a-2a64-449d-b61f-78a76ba44ada-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-852576da-c9a5-4aa2-8d7e-726180bd1604-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-852576da-c9a5-4aa2-8d7e-726180bd1604-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-852576da-c9a5-4aa2-8d7e-726180bd1604" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-852576da-c9a5-4aa2-8d7e-726180bd1604" acquired by "delete_volume" :: waited 0.016s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e4d081-0860-47a0-8576-34dd59fedf76]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:26 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:26 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 Sep 25 11:57:26 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:27 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604" returned: 0 in 0.398s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:27 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604 Sep 25 11:57:27 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:27 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-852576da-c9a5-4aa2-8d7e-726180bd1604" returned: 0 in 0.275s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-852576da-c9a5-4aa2-8d7e-726180bd1604" released by "delete_volume" :: held 0.747s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Created reservations ['faa73e50-17a7-49ad-8590-7f71b76661d2', '182b19a8-5010-4d82-90d5-3d42938ef32a', '668b4563-57da-4da4-badf-90d3372dd560', 'bca61c84-3756-46d5-bb1f-3e9f03288945'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:27 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:57:27 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:27 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.306s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:27 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:27 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Deleted volume successfully. Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-44018aac-f89d-43c6-97d8-d7dc472b8672 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-852576da-c9a5-4aa2-8d7e-726180bd1604-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87356) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (582d0eeb-0855-4fda-8ddd-8176306a1085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0bed55-dfa8-4fb4-8e63-e06599704e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0bed55-dfa8-4fb4-8e63-e06599704e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539327899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e174135f-1499-4cdc-89af-ff5c59580ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:28Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7488c70-3a01-4e26-b288-ebb1c980d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7488c70-3a01-4e26-b288-ebb1c980d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419323a0-0cab-40d5-b643-64a58c779c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419323a0-0cab-40d5-b643-64a58c779c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e174135f-1499-4cdc-89af-ff5c59580ab3', 'volume_name': 'volume-e174135f-1499-4cdc-89af-ff5c59580ab3', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248fdfce-7699-4a69-b9fa-9b69aedaca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248fdfce-7699-4a69-b9fa-9b69aedaca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23da8a66-8044-424c-8229-3e6712fe93ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:28 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Volume e174135f-1499-4cdc-89af-ff5c59580ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e174135f-1499-4cdc-89af-ff5c59580ab3', 'volume_size': 1} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539327899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e174135f-1499-4cdc-89af-ff5c59580ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a5f91be224180acc5f759293fd62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:28Z,use_quota=True,user_id='a50ec47def7543dab463033bc065fc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0e2efc-10fb-4995-a222-f6eb323a52e5),volume_type_id=0c0e2efc-10fb-4995-a222-f6eb323a52e5)}" {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Creating volume e174135f-1499-4cdc-89af-ff5c59580ab3 {{(pid=87356) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Selected osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 as target Quobyte volume. {{(pid=87356) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:57:28 devstack cinder-volume[87356]: INFO cinder.volume.drivers.remotefs [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] casted to osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724 Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 1073741824 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:28 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 1073741824 Sep 25 11:57:28 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:28 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 1073741824" returned: 0 in 0.434s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:28 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:28 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 Sep 25 11:57:28 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:29 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3" returned: 0 in 0.259s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'} {{(pid=87356) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23da8a66-8044-424c-8229-3e6712fe93ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e174135f-1499-4cdc-89af-ff5c59580ab3', 'volume_size': 1}' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed2ab0f-1236-4c19-bef3-f17fd3da65a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:29 devstack cinder-volume[87356]: INFO cinder.volume.flows.manager.create_volume [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Volume volume-e174135f-1499-4cdc-89af-ff5c59580ab3 (e174135f-1499-4cdc-89af-ff5c59580ab3): created successfully Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed2ab0f-1236-4c19-bef3-f17fd3da65a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87356) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Flow 'volume_create_manager' (582d0eeb-0855-4fda-8ddd-8176306a1085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87356) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:29 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-cef27e3b-c69c-47b2-b583-544f9c1a2d8c tempest-ProjectReaderTests-1063681058 None] Created volume successfully. Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Creating offline snapshot e0939d19-ae66-4c2b-b589-fdb8a07178bf of volume e174135f-1499-4cdc-89af-ff5c59580ab3 {{(pid=87356) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a84f36-afdb-4dd9-a297-63c8ae179a3f]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:29 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:29 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 Sep 25 11:57:29 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:30 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3" returned: 0 in 0.380s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf 1G {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:30 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf 1G Sep 25 11:57:30 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:30 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf 1G" returned: 0 in 0.443s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174135f-1499-4cdc-89af-ff5c59580ab3 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:30 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174135f-1499-4cdc-89af-ff5c59580ab3 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf Sep 25 11:57:30 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:30 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174135f-1499-4cdc-89af-ff5c59580ab3 -F qcow2 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf" returned: 0 in 0.309s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:30 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf is being set with open permissions: ugo+rw Sep 25 11:57:30 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:30 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf Sep 25 11:57:30 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:31 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf" returned: 0 in 0.260s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:31 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.info Sep 25 11:57:31 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:31 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.info" returned: 0 in 0.257s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:31 devstack cinder-volume[87356]: WARNING cinder.volume.drivers.remotefs [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.info is being set with open permissions: ugo+rw Sep 25 11:57:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.info {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:31 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.info Sep 25 11:57:31 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:31 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.info" returned: 0 in 0.267s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:31 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:31 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-a317c66d-7416-40f0-806a-05af0bae4083 tempest-ProjectReaderTests-1063681058 None] Create snapshot completed successfully Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-e0939d19-ae66-4c2b-b589-fdb8a07178bf-delete_snapshot" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-e0939d19-ae66-4c2b-b589-fdb8a07178bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-e174135f-1499-4cdc-89af-ff5c59580ab3" by "delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-e174135f-1499-4cdc-89af-ff5c59580ab3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-e0939d19-ae66-4c2b-b589-fdb8a07178bf" by "_delete_snapshot" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-e0939d19-ae66-4c2b-b589-fdb8a07178bf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Deleting offline snapshot e0939d19-ae66-4c2b-b589-fdb8a07178bf of volume e174135f-1499-4cdc-89af-ff5c59580ab3 {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] snapshot_file for this snap is: volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf {{(pid=87356) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[424f1c26-3351-49a4-b997-3dfddcee0bc7]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:32 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:33 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf Sep 25 11:57:33 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:33 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf" returned: 0 in 0.436s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:33 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.remotefs [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e174135f-1499-4cdc-89af-ff5c59580ab3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87356) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:57:33 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d1be08-7530-45ff-9aac-d813abbbfaa4]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:33 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 Sep 25 11:57:33 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:33 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3" returned: 0 in 0.440s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:33 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:33 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf Sep 25 11:57:33 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:34 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf" returned: 0 in 0.399s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:34 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf Sep 25 11:57:34 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:34 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3.e0939d19-ae66-4c2b-b589-fdb8a07178bf" returned: 0 in 0.288s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-e0939d19-ae66-4c2b-b589-fdb8a07178bf" released by "_delete_snapshot" :: held 1.681s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-e174135f-1499-4cdc-89af-ff5c59580ab3" released by "delete_snapshot" :: held 1.704s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Created reservations ['78d692e5-eb9a-4c1e-9888-55efe69fdc04', 'c3597cc2-1deb-434a-af15-3a14ecec6970', '76a1f52b-7147-4fbb-8465-7895f0b0cd59', 'c0536afb-e548-4bcd-80f8-0a1f35bf3f6f'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:34 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Delete snapshot completed successfully. Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-35a7f84f-c16e-41cc-bf34-dd0e41aac0e2 tempest-ProjectReaderTests-1063681058 None] Lock "cinder-e0939d19-ae66-4c2b-b589-fdb8a07178bf-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-e174135f-1499-4cdc-89af-ff5c59580ab3-delete_volume" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:34 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Lock "cinder-e174135f-1499-4cdc-89af-ff5c59580ab3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Acquiring lock "cinder-quobyte-e174135f-1499-4cdc-89af-ff5c59580ab3" by "delete_volume" {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-e174135f-1499-4cdc-89af-ff5c59580ab3" acquired by "delete_volume" :: waited 0.024s {{(pid=87356) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:35 devstack cinder-volume[87356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65861b5-c44a-44d6-9ea2-b7477ed73291]: (4, 'qcow2') {{(pid=88547) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:35 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 Sep 25 11:57:35 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:35 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3" returned: 0 in 0.487s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:35 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3 Sep 25 11:57:35 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:35 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:35 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b/volume-e174135f-1499-4cdc-89af-ff5c59580ab3" returned: 0 in 0.341s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:35 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Lock "cinder-quobyte-e174135f-1499-4cdc-89af-ff5c59580ab3" released by "delete_volume" :: held 0.913s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG cinder.quota [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Created reservations ['20cc9c8d-1ffe-40e0-9ed6-5e7fd4d30842', 'b71944f5-d028-4f4e-9ec2-71668c25c2a4', '35e07d47-62ff-487b-a046-d0be38b7f103', 'c2f9cea1-3f16-4602-9983-e1cb7a212841'] {{(pid=87356) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:36 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:57:36 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:36 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.266s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:36 devstack cinder-volume[87356]: INFO cinder.volume.manager [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Deleted volume successfully. Sep 25 11:57:36 devstack cinder-volume[87356]: DEBUG cinder.coordination [None req-c893e4a0-9af6-4b9a-a177-359ce425a2db tempest-ProjectReaderTests-1063681058 None] Lock "cinder-e174135f-1499-4cdc-89af-ff5c59580ab3-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87356) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:46 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=78,cinder:INSERT=28,cinder:UPDATE=99,cinder:DELETE=7 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:57:46 devstack cinder-volume[87356]: DEBUG dbcounter [-] [87356] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=87356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724': None} {{(pid=87356) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG cinder.volume.drivers.quobyte [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f3d8f02-5ace-48f2-81dd-ccb27de0b724'] {{(pid=87356) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.lockutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87356) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:23 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b Sep 25 11:58:23 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:23 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG oslo_concurrency.processutils [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae60833aba45764706c0730b63cd170b" returned: 0 in 0.266s {{(pid=87356) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG cinder.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Notifying Schedulers of capabilities ... {{(pid=87356) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG oslo_service.periodic_task [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] Running periodic task VolumeManager._thread_info {{(pid=87356) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread count: 28 {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:58:23 devstack cinder-volume[87356]: DEBUG cinder.volume.manager [None req-f420a2e6-2927-42e7-aed0-fc61cec165b7 None None] thread info: [<_MainThread(MainThread, started 129017489850496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87356) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}